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ABSTRACT 

This final report describes a 3-year project which 
investigated the relationship between academic learning time (ALT) 
and achievement in reading and mathematics of mildly handicapped 
students within the context of different special education delivery 
systems. Subjects were 24 educably mentally retarded, learning 
disabled, and emotionally disturbed students, aged 7-13 years, in 
grades 1-5. During the first one and a half years, descriptive data 
were collected to determine the amount and kinds of ALT to provide. 
During the last one and a half years, interventions based on the 
results were carried out and evaluated. The relationship of increased 
direct instruction to' increased academic engagement was reported as 
the most dramatic overall ALT finding. Section 1 of the document 
consists of the text of a teacher's manual summarizing the research 
findings and suggesting strategies for increasing ALT and student 
academic achievement. Sections 2, 3, and 4 present a review of the 
literature, a summary description of project activities and 
methodology, and results and discussion. In section 5, conclusions 
and limitations are discussed, and questions for further research are 
posed. Appendices include: (1) Academic Learning Time Observation 
System (ALTOS) coding forms; (2) ALTOS Observer Reference Manual; (3) 
ALTOS Reference Manual for Teacher Logs; (4) sample teacher printout 
and directions; and (5) source listing of BASIC programs. (JW) 
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INTRODUCTION 



A positive relationship has been reported between the amount of 

0 

academic learning time (ALT) and academic achievement of normal students 
in regular classroom settings. There has been a dearth of data prior to 
the present study, however, indicating whether this relationship exists 
for handicapped 'children. This project investigated the relationship of 
academic learning time and achievement in reading and mathematics of 
mildly handicapped students within the context of different special 
education delivery systems. Academic learning time includes the amount 
of instructional time allocated to reading and mathematics, the amount 
of time in which students are engaged during the allocated time, and the 
degree of student task success when engaged. 

During the first one and a half years of the project, descriptive 
data were collected to determine the amount and kinds of ALT provided to 
mildly handicapped students and its relationship to student achievement 
in reading and mathematics in self-contained, resource room, and 
mainstream settings. During the last one and a half years interventions 
based on the descriptive results were, carried out and evaluated in terms 
of their success in increasing the ALT of mildly handicapped students, 
as well as their academic achievement. Near the end of the project, a 
teacher's manual was prepared which summarized the effects of various 
teaching strategies on the ALT and achievement of mildly handicapped 
students. 

^varvicu) of Thio Bcpovt 

;?£'/(./':' /"< iJ 2. This section of the report contains the manual written 
for special education teachers (and administrators) summarizing the 



findings from the present study and others. Although the language of the 
manual is intentionally non-technical, it does present a relatively 
brief summary of research findings and Jtheir. implications for 
educational practice. Sections 2, 3 and" 4 then detail the relevant 
literature, project activities and results of data analysis. 

SECTION 2. A review of the literature on the relationship of ALT and 
academic achievement of normal children is presented. ^Since there were 
no data on the nature of this relationship concerning mildly handicapped 
children when this study began, this literature review served as a basis' 
for identifying variables and methodologies considered important in 

c 

designing the present study. 

SECTION 3. Instrumentation and methodologies of data collection are 
discussed along with a summary description of project activities over its 
three year duration. 

SECTION 4. Results of data analysis are presented and discussed in 
considerable detail in this chapter. 

SECTION 5. Conclusions from this study are reiterated, its 
limitations are indicated, and questions for further research are 
suggested. 
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SECTION 1 



TEACHER'S MANUAL 

TEACHING STRATEGIES FOR INCREASING 
ACADEMIC LEARNING TIME AND 
STUDENT ACADEMIC ACHIEVEMENT 



INTRODUCTION 

Recently, a substantial number of educational studies have sought to identi- 
fy activities which significantly impact on student achievement. The results of 
these studies have produced virtual universal agreement that Academic Learning. 
Time (ALT) is one of the most significant determinants of student achievement. 
ALT refers generally to the time students spend actively engaged in academic 
tasks which they complete with high success. It contains three components that 
have been found to be highly related to student achievement: 1) Amount of time 
allocated to instruction, 2) Amount of time that students are actually engaged 
in academic activities, and 3) Amount of time that students are engaged in 
academic activities completed with high success. 

Allocated .time . The amoun: of time allocated by a school district and/or a 
teacher for instruction has been found to be an important predictor of student 
achievement. Some studies have demonstrated that the length of the school day 
and the .length of the school calendar influence student achievement. Other 
studies have found that the more time that a teacher allocates to a subject 
■matter area, the greater the level of student achievement. _ Further studies have 
systematically examined the amount of time that is actually allocated for in- 
struction in typical classrooms. The results indicated that in selected second 
grade classrooms 57% of the school day was allocated to academic activities, 
with 24* devoted to non-academic subjects such as music, art, affective and 
physical education, and the remaining 19% was spent in transitional activities. 
Fifth grade pupils had 60* of their time allocated to academic activities, 23* 
to non-academic activities, and 17* to transitional activities. This information 
suggests, that room exists for increasing the amount of time that is allocated for 
instruction. Wo also know that, should this occur, it is likely that student 
achievement will increase. 
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Enga g ement tim e. The second component of ALT is the proportion of allo- 
cated time that students are actively engaged in academic tasks. Student en- 
gagement time was found to be even more highly Elated to student achievement 
than allocated time. These results suggest that students who pay attention to 
and work more on academic tasks are also those who learn more. Studies that 
have examined the amount of time that students are engaged during the school 
day have reported results ranging from 40 .to 80%. Information reported by most 
authorities suggests that at least 80% engagement is optimum for most students. 

Success_time. The final component of ALT is student success rate on aca- 
demic tasks. Studies have clearly indicated that the more time that students 
spend on tasks which they complete with high success, the greater their level of 
achievement. These studies reveal that pupils who spend more than half of their 
time on high success tasks (i.e., tasks on which students attain accuracy scores 
of 80% or higher) also attain higher achievement test scores, maintain their 
knowledge longer, and have more positive attitudes toward learning. Such re- 
sults suggest that learning basic skills in the elementary grades requires stu- 
dents to experience success on assigned tasks and to thoroughly master skills. 

Academic success and skill mastery depend very heavily upon accurate 
structional programming. Studies have demonstrated that high student achiev 
ment is related to teacher ability to accurately assess students' academic sk 
and to provide appropriate and adequate instructional activities. Although, 
the surface, this observation represents nothing new-practicioners have forever 
diagnosed students' needs and prescribed instruction-successful results depend 
on the manner in which the assessment, programming and instruction are con- 
ducted.. The most compelling evidence indicates that, to maximize a student's 
success on a particular academic task, a teacher should first assess a student's 
ability to perform the task, provide materials or procedures to directly teach it, 
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and then regularly monitor student progress on the task. Such systems provide 
feedback to students regarding their performance, as well as to the teacher 
concerning the effectiveness of thg instructional programs. 

Question ; Liiven the aboveMnformation, what can you as a teacher specifi- 
cally do to increase the academic achievement of the students in your class- 
room? Answer : Read the subsequent sections of this manual for specific sugges- 
tions on how to increase student academic achievement. 
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TEACHING STRATEGIES THAT INCREASE 
STUDENT ACADEMIC ACHIEVEMENT 



What can you, the teacher, do to increase student academic achievement in 
your classroom? Studies conducted in thousands of classrooms in the U.S. have 
identified a number of specific things that more effective teachers do that are 
associated with greater academic achievement: 

- Spend more time on academic subjects, 

- Evoke more student attention to academic tasks, 

- Provide more direct academic instruction, 

- Provide more aqademic activities in which students experience hwh task 
success. r ° 

In many ways these four areas overlap and are interrelated. But the mes- 
sage is clear from the educational studies over the last decade: What is not 
taught and attended to in academic areas is not learned. Teachers who are task 
oriented and determined that their students learn are more effective. 

We now want to discuss in concrete terms what it is that these effective 
teachers do. Hopefully, none of these recommendations will surprise you. As you 
read, think about your :lassroom and students. Ask yourself, "How many of 
these things do I frequently do in my classroom? What could I do differently 
that would increase my teaching effectiveness?" 
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SPEND MORE TIME ON ACADEMIC SUBJECTS 

Your immediate response may bfe, "But my daily schedule is already full. 
How can I allocate more time for academic subjects?-. Before we try to answer 
this question, consider this: Studies show that the more time spent and the more 
content covered in a subject matter area, the more students achieve in that 
content area. This should not be surprising. But what js surprising is the 
jremendous vanabiUt* in the amount of time that teachers allocate to various 
A content areas. In some elementary classrooms, for example, students were ob- 
served to spend an average of Jess than one minute £er dav in reading instruc- 
tion, compared to other classrooms where students spent an average of mor^ 
ihan nyo and^a half hours per dav! Sounds incredible, but that's what was ob- 
served. Of course, these are extreme cases. 

One strategy for allocating more time to academics is for a teacher to look 
at the difference between scheduled time and allocated time. For example, a 
teacher may schedule math from 11:00 a.m. to 11.40 a.m. each day (*0 minutes 
per day). However, by the time the kids arrive from their physical education 
class and get settled, the math activity doesn't really get started until about 
11:10. Subtract 10 minutes. During the lesson, several students become disrup- 
tive and start pencil jabbing. The teacher stops them and interrupts the class to 
give a short lecture on the dangers of pencil jabbing. Subtract 5 more minutes. 
Then, by about 11:30 most of the students have finished the math assignment. 
The teacher tells them, "Since it's so close to lunch time, you have 10 minutes 
of free time." Subtract 10 more minutes. 

In this example, which is probably not atypical, forty minutes were sched- ' 
uled for math, but only 15 minutes were actually spent in math instruction. This 
example also illustrates three causes of decreased instruction time: 
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1) Time spent in transition between activities, 

2) Time spent disciplining or managing student misbehavior, 

3) Time students spend waiting during a scheduled activity. 

Without changing your schedule, you can increase time spent in academic 
content areas by decreasing total transition time, student misbehavior and stu- 
dent jait time. You can also increase time .spent in specific academic content 
areaf b*y scheduling more time for those subjects. 

1. Transition time . In our studies we found that students spent an average 
of about *5 minutes P er day in total transition time. This is the time that ac- 
cumulates during the school day between the end of one activity and the begin- 
ing of the nelT activity. In some classrooms there was as little as 25 minutes of 
transition time on a given day, and in others as much as 90 minutes. Of course, 
some transition time is inevitable. 



PROJECT ONE: Here's a little project for you to do: Make a copy of your 
weekly schedule of activities, including lunch, recess, collecting lunch money, 
taking attendance, etc., as well as the usual subject areas such as reading, spel- 
ling, math, science, sociaT studies, art, music, and P.E. For one week, write 
down on your schedule the exact clock times that each activity actually begins 
and ends. An activity begins when your students actually start dealing with the 
directions or substance of the learning activity. Likewise, an activity ends when 
your students actually stop dealing with the content of the learning activity. 
Keep a record of these activity start and stop times for a week. At the end of 
the week, add up the time intervals between activities (i.e., transition time). 
Divide by five to get the averse amount ot transition time per day. 



If you're like most teachers when you complete PROJECT ONE, you may be 
surprised at how quickly transition time accumulates. Think of it this *av: If 
you can decrease transition time by 15 minutes per day, then over the course of 
a ISO-day school year, you will have 45 more hours to sfiend on Jn^tojcjion. 

How can you reduce transition :irne? There are many ways. Here are two: 

Make sure that all necessary lesson materials and supplies are assembled 
beforehand and are near at hand for both you and your students. 

Start an activity promptly. Don't wait for stragglers. At first some "foot 
draggers" may miss out on the beginning of a lesson, but they'll soon get 
the message that you mean business. , 

•Some teachers feel that transitions between activities provide respite for 
students-i.e., "break time". We agree that some break time is necessary, since 
it is unrealistic for students to concentrate continuously all day long.- In ele- 
mentary schools, morning and afternoon recesses and lunch help fulfill the need 
for break time. However, when the transition time between school and classroom 
activities which accumulates during the day becomes greater than the time 
spent on an .important academic subject area, a teacher should evaluate ways of 
reducing transition time and increasing instructional time. 

j^JTime spent disciplining. Obviously, the more student of '-task behavior 
there is, and the more time you need to spend disciplining or managing it, the 
less time there is available for instruction and learning. There are hundreds of 
methods of dealing with misbehavior, but research has not shown any method to ' 
be always superior to all others. In a famous study by Jacob Kounin. he discov- 
ered that the specific type of classroom behavior management technique was 
not nearly as important as its correct targeting and timing. He coined a term, 
"withitness", to describe teacher disciplining which has correct targeting and 
timing. Withitness promotes high student Msk involvement and minimal misbeha- 
vior. Teachers »ho are "withit" continually -monitor their classrooms for potenti- 
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a] behavior problems, and they communicate to ^ students that they l< n .w 
vhafs going on. If there is a misbehavior, a "withit" teacher correctly identi- 
fies misbehaving students (correct targeting) and deals with it immediately 
(correct timing). 

Teachers who make target errors may discipline the "wrong" student (one 
who is innocent, an onlooker, or an imitator), or deal with a less serious misbe- 
havior when a more serious misbehavior is occurring. A timing error occurs 
when the misbehavior "spreads" to other students or increases in seriousness 
before the teacher does something about it. 

Thus, one effective way to minimize student misbehavior is to be "withit" in 
classroom behavior management. When less student misbehavior occurs, more 
time can be spent on the content of the lesson. 

Another method, which has successfully increased the amount of appropriate 
student behavior and diminished inappropriate behavior, is to praise students 
periodically for paying attention and for behaving appropriately. For example, a 
teacher might periodically look around che classroom while conducting a reading 
group to .identify and verbally praise students who are behaving appropriately. 
This practice has two distinct advantages. First, it provides teacher attention 
to students who are behaving appropriately, thus reinforcing that behavior, and 
secondly, those students are presented as socially acceptable models for other 
members of the class to emulate. 

3 . Time students spend waitin g. In our study students were observed to 
spend an average total of about 19 minutes per day waiting during, activities. 
This means that they were either finished with their work early, or they, could 
not continue working because they were waiting on the teacher or someone else 
in order to continue. Over the course of a 130-day school year, that adds up to 
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approximately 55 hours spent waiting. Note that wait time does not in.ck.do time 
spent in transition between activities. 

Of course, some student waiting is inevitable. For example, if a student is 
stuck on an assignment and needs help, it may be serverat minutes before you 
can get free to help that student. On the other hand, when some students finish 
an assignment early, you can simply prepare in advance .similar additional work" 
for those faster working students. You could have a folder or file of ~.js" 
assignments or -challengers 1 ' that students know they can do if they finish the 

« 

original assignment early. If possible, these extra tasks should be clearly related 
to the objectives of the original assignment. 

Another common example of student wait time occurs when elementary stu- 
dents stand in line at the teacher's desk waiting to get their papers graded.. A 
couple of ways you can decrease this kind of wait time is to: 1) Provide answer 
sheets so that students can correct their own papers after they are finished. ?) 
Correct papers afterwards as a group activity (and you can spot check answer 
sheets occasionally). Students car, exchange papers if you're concerned about 
cheating. Needless to say, these strategies will not be suitable for some assign- 
ments, but you can decrease wait time using these strategies on assignments 
which are suitable. 

Scheduling. You should not overlook the possibility of scheduling more 
time for certain kinds of academic activites. Of course, there will be trade-offs 
in time scheduled for other activities, since the total amount of time per day is 
fixed by school hours. For example, scheduling 10 more minutes per day for 
reading instruction adds up to 30 extra hours of time allocated to reading over 
the course of a .school year. You might think that, when allocated time is in- 
creased, student attention will tend tn decrease. Studies have shown, however, 
that this does not generally happen. When time allocated to a particular content 
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area is increased, total student engagement time in that content area also 
increases. 

Another way to beef up your schedule is to include, for example, more 
reading, writing, and math related activities in other subject areas, such as 
science and social studies. Students can get practice in the basic skills while 
they are learning other content as well. 

c 

Summary.. You can increase the amount of time spent in instruction on 
academic content areas by: 

- Reducing transition time between activities, 

- Decreasing student misbehavior and time spent disciplining, 

- Decreasing student waif time 'during activities. 

- Increasing time .scheduled for those content areas. 



9 

ERIC 



16 



J 



13 



EVOKE MOR E STUDENT ATTENTION TO ACADEMIC TASKS 

Even though you have maximized allocated instructional time,* some students 
may have relatively low task engagement rates. For example, Jimmy may pay 
attention about 60* of the time, whereas Salfy is usually on-tasl< SO* of the 
time. These task engagement rates are not uncommon. On the average, most 
students pay attention to academic learning activities between 70 and 75% of 
the time. ( 

Studies have shown that increased student engagement time in academic 
content areas is associated with greater achievement in those areas. Again, it 
doesn't take long for small differences in daily engagement time to add up. For 
example, suppose you have scheduled and spend 90 minutes in reading instruc- 
tion per day. If a. student is engaged 70* of the time, his/her engagement time ' 
in reading is 70% X 90 minutes, or 63 minutes per day on the average. If that 
same student were to increase his/her engagement rate to 80*. then total en- 
gagement time would be 72 minuses per day. You may say, "Nine more minutes 
of student engagement per day doesn't-sound like much." But consider -that this 
is equivalent to 27 more hours of student engagement, time in reading over the ' 
course of a school year. Looking at it another way, at a 70* engagement rate, 
about 5 extra weeks of school would be required to equal the total' amount of 
engagement time a child would accrue at an SO* engagement rate during the 
normal school year. \ 

What can you do to increase stude.it attention? Of course,* so.no factors are ' 
often beyond your direct control, such as student motivation to learn, student 
fatigue (due to . not enough sleep, poor diet or- health, low blood sugar), the hu- 
midity and temperature in the classroom, etc. There are other things you can 
control, however i ' 
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. - Praising students for appropriate behavior, 

- Being "withit", 

- Doing more groupwork and providing more direct instruction, 

- Providing a variety of learning tasks, 

- Supervising seatwork activities more closely. 

Praising students for ap propriate behavior . Many studies have demonstrated 
that teacher praise . provided to students who are working diligently on their 
assignments served to increase student engagement. This technique was found to 
work even more effectively when it was combined with ignoring off-task .be- 
havior. Later studies found that the positive effects of this technique also 
spilled over to students seated adjacent to the target students. Unfortunately, 
this technique is frequently overlooked because of its simplicity. But the point 
remains that it has been found to be one of the most effective techniques for 
increasing student engagment. In addition, many other studies have been co;i- 

4 t 

ducted that demonstrate that point systems are very effective devices for in- 
creasing student engagement. 

Being "withit". As discussed above, teachers .who. are more "withit" have 
classrooms whose students are on-task a greater proportion of the time -and mis- 
behave less often. Being "withit" means that you have "eyes in the back ol your 
head" and communicate to your students that you are aware of. what each stu- 
dent is doing. A "withit" teacher deals with 'of f-task- student behavior with cor- 
rect targeting and timing. A positive form of "withitness" is to be aware of stu- 
dents who are actively engaged with the task, and praise those students. Studies 
have shown that teachers' have been able to successfully increase student task 
engagement rates by regularly scanning their classrooms (e.g., once every tive 
minutes), identifying those students >vho are on-task, and then providing some 
kind of reinforcement to those sMdents. 
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Doing more groupwork. Studies have shown that students generally pay more 
attention" during teacher-led group activities, compared to independent seatwork 
activities. We believe that the major reason for this increased student engage- 
ment is that more direct instruction is usually provided during teacher-led group 
activities. In our study we found that any given student was on-task an average 
of 95* of the time when direct instruction was being provided-either specific- 
ally to that student, to another student in the group, or to the group as a 
whole. On the other hand, when no direct instruction was being provided to the 
student or group including the student, s/he was engaged about 5*% of the time 
on the average. Another way of looking at this, students were 3 times more 
jikelv to be off-task when no direct instruction was being provided, compared 
to jheir ofNtask behavior N^^there vas direct instruction . Direct instruction 
includes teacher feedback, questioning, explaining, and structuring/directing. 
More will be said about direct instruction in a later section. 

Studies have indicated that 30 to 40* of the time is typically devoted to 
teacher-led group activities at the elementary level, and about 60 to 70% of the 
time is spent in independent seatwork activities. Thus, one way to increase stu- 
dent attention is to schedule more group activities and therefore less indepen- 
dent seatwork. If you do more group activities, you will automatically increase 
the amount of direct instruction that you pr6vide. This will result in increased 
student attention and, in the long run, greater gains in academic achievement. 

A concrete way to go about increasing the number of group activities is to 
consider one activity per day that you have scheduled for seatwork (e.g., a lan- 
guage arts or math worksheet). Then, think of a practical way to convert that 
seatwork content into a group activity. By doing just one more group activitv 
per day (and one- less seatwork activity), we have estimated that total engage- 
ment time per student would increase by about 21 Hours over the course of a 
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school year-thafs just for one more 20-minute teacher-led group activity per 
day. 

Several caveats are in order here: First, increasing groupwork does not im- 
ply that seatwork should be excluded. Students obviously do need time to work 
by themselves at their own pace during certain stages of learning. Second, stu- 
dent skill levels must be taken into account in groupwork. If the students in the 
group are too divergent in their skill levels, doing an activity in one large group 
may be counterproductive, and it may be best to group students according to 
ability and instruct them in a group, while students who could no, profit f,om 
this type of instruction are assigned seatwork. Third, it is worthwhile to consid- 
er the reasons why students are off-task more often during seatwork. Part of 
their inattention can be attributed to the nature of teacher supervision of seat- 
work. (More will be said about this in a later section.) A more important reason 
may be that the tasks required during seatwork may not be very interesting to 
students or instructions are unclear. Much seatwork at the elementary level 
consists of worksheet or workbook activities. In effect, this format requires 
that students do a great deal of "pencil pushing". It may be worthwhile to con- 
sider other kinds of independent seatwork formats besides worksheets. 

Providing a variety of learnin g tasks. More variety of activities during a 
lesson is associated with higher student engagement rates and achievement 
gains, according to the results of classroom observational research. If there is 
little variety in classroom learning tasks, students .will find ways to introduce 
variety themsel ves-of ten this will be in the form of off-task behavior. The old 
adage, "variety is the spice of life," applies to learning as well. I n light of the 
above discussion, one 'simple .vay to introduce variety is by alternating group 
and seatwork activities. In our study ve observed a teacher who did not do this. 
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She typically scheduled entire mornings with mostly seatwork activities and the 
afternoons were devoted primarily to groupwork. Predictably, we observed a lot 
of off-task behavior in the mornings. By simply alternating seatwork and group- 
work throughout the day, this teacher could have substantially increased student 
engagement time. 

Furthermore, studies have shown that student engagement .is higher during a 
seatwork activity which immediately follows a grour > activity th^n it is during a 
seatwork activity which foliows a previous seatwork activity. 

Other ways to increase variety can be achieved after careful consideration 
of the types of tasks that students are expected to perform-i.e., the content of 

the tasks and the kinds of responses students are required to make. Think about 
varying from task to task -the sensory modalities used (i.e., seeing, hearing, 
smelling, touching, tasting) and the kinesthetic requirements. 

: S upervising seatwork activites more closely . Studies have shown that stu- 
dent attention is higher during seatwork when there is more active supervision. 
Active supervision means that the teacher circulates among the class, monitor- 
ing the progress of student work, occasionally providing encouragement and spe- 
cific feedback to students, and providing assistance to students when needed. 

If you are working with another group at the time, you can position yourself 
so that you can keep an eye on the students in seatwork. Kounin identified a 
teacher behavior that he termed, "overlapping", which refers to teacher mani- 
festation of attention to more than one student , or activity at the same time. 
For example, suppose you are working with a small reading group and you notice 
that Cindy (in seatwork) has just gone off-task. Without interrupting your small 
group, you look up and quickly praise Cindy's neighbor Marv for paving atten- 
tion. Then if you note that Cindy has returned to task, she could be praised. \t 
the sam..- ti ne, you have not disrupted the flow of your reading group. Or sim- 
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pose that Edward (also in seatvvork) comes to you for help while you are con- 
ducting the reading group. You briefly assist Edward, while at the same time 
keeping the reading group going. These are examples of teacher "overlapping". 
Teachers who -overlap" more often have classrooms with higher student task 
involvement. 

Thus, when the whole class is. doing seatwork, you can actively supervise by 
circulating and monitoring. If part o{ the class is doing seatwork and the re- 
mainder are in a group you are leading, you can actively supervise by -overlap- 
ping". Obviously, you don't want to overdo active supervision to the extent that 
it disrupts student attention to task or makes students feel nervous about being 
observed. On the other hand, if students know they're not being closely super- 
vised during seatwork, they are more likely to be off-task. Let them know that 
you are aware of what they're doing and that you're trying to help them learn. 
This will help increase student attention during seatwork. 

Summary,. There are at least five things you can do to increase student 
attention: 

- Praising students for appropriate behavior, 

- Being "withit", 

- Doing more group and less seatwork activities, 

- Providing a variety of learning tasks, 

- Supervising seatwork activities more closely. 
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PROVIDE MORE DIRECT ACADEMIC INSTRUCTION 

We have defined 'direct academic instruction' as interaction with students 
on the substance or directions of an academic task. Research studies hav? found 
, that more direct instruction in academic content areas is associated with great- 
er student achievement gains in those academic areas. Teachers who engage in 
more direct academic instruction tend to lead more group activities, as dis- 
cussed above, atibough direct academic instruction can also occur in-seatwork 
settings wM individual students. Direct academic instruction includes: 

- F t '..j!^ack, '. 
s - Questioning, 

- Explaining/modeling, 

- Structuring/directing. 

Academic^feedback. This occurs whenever the student is informed of the 
correctness or incorrectness of his/her response(s) on the substance of an aca- 
demic task. Note that, while the teacher is often the source, feedback to a stu- 
dent can also come from the learning materials themselves, a peer, an aide, or 
an instructional device such as a computer. Research has generally indicated 
that more academic feedback is associated . with greater gains in achievement. 

Obviously, feedback is important, for without it, how would students know 
that they have correctly learned? Also important is the timing of feedback. 
Studies have shown that the more immediately feedback » given, the more ra- 
pidly learning occurs. Immediate feedback is particularly crucial when students 
are initially learning to do a completely new task. 

Feedback is basically either positive or negatives Examples of positive feed- 
back are "That's right."". "Yes.", "Good.". "Correct.", "You got them all right!", 
*tc. Positive feedback ^especially important with low-achieving, disadvan- 
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taged, and mildly handicapped children, as .veil as students from low socioeco- 
nomic backgrounds (low SES). Examples of negative feedback are "No.", -That's 
not right.-, -Wrong.-, "Try again.-, -You missed three problems on the assign- 
ment.-, etc. Negative feedback should be minimized with low-achieving, disad- 
vantaged, mildly handicapped, and low SES students. On the other hand, studies 
seem to indicate that high-achieving students tend to be more tolerant of nega- 
tive feedback, and if used judiciously, it can enhance academic achievement. 

A common saying is that we learn from our mistakes. Students need to know 
when they have made errors. Therefore, some negative feedback is necessary. 
However, it is very important that the student does not feel demeaned or criti- 
cized as a person when negative feedback is given. Consider these two con- 
trasting examples of negative feedback: 

-Wrong again. You really' oughta try harder. You can't learn if you don't 

/ Irou^VX^^ ag3in t0§ther - PU * iv * V- *>™ '^ts as we work 

The first instance connotes blame or criticism of the student, whereas the 
second example indicates a teacher willingness to help the student learn. Again, 
research .indicates that teacher 'criticism is negatively related to student 
achievement. 

There used to be a TV commercial for aspirin that showed an irritated and 
frustrated person with a headache saying, "Please! I'd rather do it myself !" 
Likewise, students need the opj^oa^um^^ 

In other words, they often want a chance to try to ffgure out and correct their 
mistakes themselves. This brings up two points: 1) Telling a student the right or 
correct answer immediately after an incorrect response mav not be as etfective 
in promoting learning as first giving the student an opportunity to self-correct 
the ^rror. Giving a prompt following an incorrect response mav be necessary 
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if the student is having some difficulty. The key point is that we don't want to 
overly frustrate a student, but at the same time we do want to give her/him an 
opportunity to self-correct his/her errors. 2) Overdoing negative feedback can 
result in lowering of student motivation and ^elf-esteem. Thus, if a student is 
making many different kinds of errors on a learning task, the teacher should 
ask, "Is this learning task too hard or too advanced for this particular student's 
skill level?" When there are many student errors on a learning task, the best 
strategy may be to show the student the correct answer and how to obtain it, 
and then plan subsequent learning activities which ameliorate those particular 
problems, should they persist. Then, provide positive feedback on correct stu- 
dent responses. 

Academic questioning . Another type of direct instruction is soliciting stu- 
dent verbal responses during a discussion or recitation activity. Studies have 
indicated that students were more attentive when they were not sure who was 
going to be called on next to answer. When teachers addressed students in some 
predetermined manner (e.g., going down the row or around the circle), students 
tended to be less attentive. Thus, asking questions which are group-focused and 
then randomly calling on students helps to maintain student attention during a 
recitation or discussion. 

Classroom studies have shown that, when teachers ask more low-level ques- 
tions which are directly related to academic content, their students tend to 
make greater gains in academic achievement. Low-level questions are usually 
convergent-there is a right answer. Th >v often v.volve recall of tactual infor- 
mation or sequence of events, giving definitions, making discriminations or ob- 
servations, giving or identifying examples of concepts, explaining simple cause 
and effect, etc. 
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Another good reason for conducting some group discussion or recitation in 
academic subjects is that it provides a change of pace from the worksheet and 
workbook activities frequently done in independent . seatwork-Ke., student re- 
sponse modalities are varied from reading and writing to listening and speaking. 
Also, by listening to students respond you can directly monitor student progress 
and provide immediate feedback. 

Academic explainfng/modHing. Another component of direct academic in- 
. struction is explaining/modeling, which includes statements dealing with the 
content (e.g.,lecturing,) and demonstrations of skills. In our study we found that, 
when teachers spent jseveral minutes or more giving' a planned explanation or 
demonstration during an activity (usually at the beginning), students were about 
five times Jess likely to perform poorly on the task than when little or no plan- 
ned explanation was given. Verbal explanations of the substance of a task are 
especially important for mildly handicapped and disadvantaged students whose 

reading comprehension is poor. 

j 

■Some studies have demonstrated that student reading accuracy is increased 
, when the teacher reads (the passage aloud before the students are asked to read 
the passage. Other studies have identified. teacher olarjty as being postively re- 
lated to academic achievement. Thus, clear explanations or demonstrations 
which deal with academ-ic substance are important. Obviously, to use your time 
efficiently, planned explanations or demonstrations should be given to the whole 
group, rather than repeatedly to individual students. 

Even for certain kinds of independent seatwork Wtivities, some explanation 
or modeling seems 'to make a difference At the' beginning of the seatwork ac- 
tivity, you can explain and/or demonstrate to the group how to do the first 
problem or two. Then, you can ask the students to try the next one or so, , iv - • 
in* Redback to the group. Finally, students can do the remainder of the assign- 
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ment on their own. This strategy is more likely to result in greater student task 
success than if you give directions only (e.g., "Turn to page 21 of your math 
book. Answer the first 10 questions. Write your answers on a separate piece of 
paper."). 

In contrast to explanations and demonstrations planned aheaJ of time, one 
large study found that explanation based on immediate student need was nega- 
tively related to achievement in regular elementary classrooms. That is, giving 
more explanations in response to immediate student difficulties or misunder- 
standings of the task is associated with Jess academic growth. This implies that 
initial explanations were possibly unclear or absent, or that the task was too 
difficult for students to begin with.' If you frequently find yourself repeatedly 
giVing explanations to individual students who are experiencing difficulties with 
an assignment, this should tell you that something's not right. Perhaps the di- 
rections for the task were unclear, the initial explanation was inadequate, or 
the task is simply too hard in its present form. 

On the other hand, these research results do not imply that you should not 
help students who experience difficulties with a learning task. But the findings 
do suggest that, when explanations based on immediate*student needs are mini- 
mized, long-term student achievement tends to be higher. 

Academic structuring/directing. Structuring/directing is similar to academic 
explaining/modeling. Structuring/directing occurs when the goals or objectives 
of a task^are discussed, or the procedures to be followed in the task are given, 
whereas academic explanations or demonstrations deal with the content of the 
lesson itself. Research has shown that more structuring/directing is associated 
with greater academic achievement. 

Teacher structuring/directing of seatwork activities was found in our study 
to be particularly important for minimizing low task success of mildly handi- 
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capped students. Since these students' reading skills are often poor, they are 
more likely to understand how they are to do an assignment if the teacher tells 
them the directions, rather than expecting them to read the directions. 

Also, telling or reminding students of the purpose of a learning activity 
helps them gain perspective on why they are to do it, other than being required 
by the teacher or curriculum. As an example of structuring, a teacher might 
say, "Learning how to spell words correctly is important so other people will be 
able to read and understand what you write." 

Summary. More direct instruction is associated with greater student 
achievement gains'. Direct instruction includes academic: 

- Feedback, 

- Questioning, 

- Explaining/modeling, 

. - Structuring/directing. 
Direct instruction of groups is also related to high levels of student atten- 
tion, compared to student attention during independe .. twork. 
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PROVIDE MORE OPPORTUNITIES F O R STUDENT HIGH TASK SUCCESS 

One of the more important findings of a recent study was the positive rela- 
tionship between student high task success, on daily academic classroom activi- 
ties and academic achievement. Student high task success means that s/he com- 
pletes a task making very few or no errors (e.g., more than 80% correct re- 
sponses). The more activities that are completed with high success, the greater 
. the achievement gains. The converse is true as well: the more activities in 
which students perform very poorly (low task success), the less the achievement 
gains. This should not be surprising, since task success on classroom activities is 
simply a daily, task-by-task measure of achievement. So it makes sense that, if 
a student frequently performs well on classroom academic tasks that are related 
to content that is covered on an academic achievement test, we would expect 
him/her to do well on the achievement test. 

This finding is also consonant with the concept of '.mastery learning'. The 
idea of mastery learning is that a student should get an 'A' on the test of at-' 
tainment of an instructional objective before moving on ,„ the next objective. It 
is . true that some students will master an instructional objective faster than 
others, but this does no. mean that the slower students should be denied the 
opportunity to master the objective as well. 

Of course, we don't expect students to do all learning activities with high 
task success. When they are in the initial stage., of learning a new objective, 
they will typically make mistakes and perform with medium task success (i.e.. 
make some errors, but not all errors). As appropriate feedback is given, their 
task performance should subsequently improve on similar tasks until „,ev per- 
form consi,t,ntly high task success on. that instructional objective. If some 
student, often perform poorly on classroom learning tasks, this should ,ell the 
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teacher something: the tasks may be too hard for those students. Another way 
of saying, this is that the discrepancy is too great between the skills and knowl- 
edge required by the task and the present skills and knowledge of the students. 
One ofjhe alarming findings in our study of mildly handicapped students was 
that they were observed to experience low task success in about 10% of the 
activities. That is, they did extremely poorly on about 1 out of every 10 tasks. 
On the other hand, normal students in another study were observed to experi- 
ence low task success about 3% of the time (I out of 33). 

What can you do to increase high student task success and also decrease 
low task success? Obviously this is a hard question to answer, but research 
findings suggest several things teachers do: 

- Becoming more familiar with students' skills and knowledge, 

- Increasing frequency of classroom testing, 

" planned explanations, demonstra- 

tions, structuring/directing and academic feedback to the group, 

" reviewed 8 ^ ° f aCtWities in which Previously learned material is. 

This list is only suggestive, clearly incomplete, and there is a good deal of 
overlap. 

Becoming more lamiliar with your student. ' specific skills and knowled ge. 
Research has shown that teachers who know their students better have class- 
rooms with greater achievement gains. Teacher awareness of specific student 
skills and knowledge was measured in one study by having teachers predict 
ahead of time which items on an achievement test that each student would pass 
or fail before they were given the test. This finding implies' that teachers who 
know their students better /ire also in a better position to select or create in- 
structional materials that are well matched to student knowledge and skill lev- 
els. Thus, their students are likely to more often experience high success on 
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classroom tasks and in the long run make greater gains in academic achieve- 



ment; 



Another source of information regarding specific student skills and knowl- 
edge is daily student worksheets. These worksheets provide up-to-date informa- 
tion concerning the students' understanding of instructional content. By simply 
reviewing patterns of correct and incorrect answers a teacher' can obtain valu- 
able information on specific student's strengths and weaknesses. This informa- 
tion, in turn, can be used to develop lessons that students can successfully 
complete. 

Increasing frequency pf testing . Studies have found that teachers who test- 
ed their students more often had students ,vho experienced less low task success 
and more high task success. Testing students need not take up a lor of time and 
can serve two important functions: 1) It provides feedback to. students on their 
learning progress; and 2) It provides feedback to the teacher on student mastery 
of instructional objectives. You don't need a lot of items on "a test to find out 
whether a student has mastered an objective. For example, if you construct a 
test of just 5 items which are representative of the content covered by the 
objective and. which are j^ndoml^ selected, you can be pretty confident that 
students who get * or 5 of the items completely correct have mastered the 
objective. Of course, if you want to be more confident or you want to diagnose, 
specific student problems, then you can increase the number of items. However, 
it doesn't take very many items to make a decision about student mastery, if 
the chances of student correctly guessing are low, and the items' are represen- 
tative of and randoinly sampled from the content. ' 

If intervals between tests are too long, then each test takes on ,n Q re< 
"importance" to the students and the? may become more anxious about testing. 
On ;he other hand, if tests are given frequently and regularly, then each test 
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becomes less "important»~i.e, if the students occasionally do not do well on a 
test it is not such a big deal, since they know they- have many more opportuni- 
ties to demonstrate mastery. ' 

It is also obvious that teachers who test their students regularly and fre- 
quently are more likely to be attuned to individual student skills and knowledge. 
As discussed above,, this teacher awareness- is related to overall student 
achievement. 

4 

• f 

Furthermore, the very process of constructing a test (or selecting one from 
the curriculum/ makes us consider just what it is that We want our students to 
learn-i.e., what our instructional objectives are, Making up a test for an in- 
structional objective ahead of time helps a teacher to plan and sequence learn- 
ing activities appropriate for reaching that objective. Worksheet content can be 
used effectively to develop highly appropriate tests of student progress. . 

Increasing direct instruction . This topic was covered in an earlier section in 
some detail, but bears repeating here. In our study we found that more direct 
instruction was associated with less student low task success. In particular, stu- 
dents were two to three times Jess likely to perform poorly on a task when' 
teachers' gave some verbal directions, planned explanation or demonstration and 
academic feedback to jthe '^roup. If the activity was mostly independent seat- 
work, these three types of direct instruction usually occurred during the begin- 
ning of the lesson and. lasted several minutes. 

. Increasin g review lessons . In a review lesson students practice using skills 
and knowledge related to instructional objectives they have already mastered. 
Since they have mastered the objective and if they have not forgotten, they 
will usually perform the task with high task success. This is a straightforward 
way : ,f increasing the amount of high task success in your classroom, It appears 
that "over learning" of materials is important for long term academic achiove- 
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ment. Obviously, review lessons should not be bunched up, but rather spaced at 
regular intervals over time. With mildly handicapped students, regular review 
seems to be particularly important, since they may be more prone to forgetting 
what they have learned. 

One simple way to do a review lesson is to take an old test, and instead of 
considering it as a test, have the students do it as a review activity. Also, if 
you discover that some students have indeed ■ forgotten, then you can plan some 
refresher activities for them. Since it is not practical to regularly review all 
material previously covered, you will need to decide which instructional objec- 
tives are most important and focus on those in your review lessons. 

Sumrnaj^. Students who more frequently experience high task success on 
daily classroom activities . make greater gains in long term academic achieve- 
ment. Things teachers can do to increase student high task success include: 

- Becoming more familiar with students' skills and knowledge, 

- Increasing frequency of classroom testing, 

- Increasing direct instruction, especially planned explanations, demonstra- 
tions, structuring/directing and academic feedback to the group, 

" reviewed 8 ^ ° f aCtWitieS in VVhich P revi ^ sl V learned material is 



■4T 



33 



30 



SUMMARY 

Studies have shown that academic learning time is one of the most 
important determinants of student academic achievement. Academic learning 
time (ALT) includes the amount of time: 1) allocated to academic content areas, 
2) students are engaged in academic tasks, and 3) students experience high 
success on those tasks. Based on the results of research studies, teaching 
strategies for increasing student achievement, were recommended: 

TO SPEND MORE TIME ON ACADEMIC SUBJECTS : 

- Reduce transition time between activities, 

- Decrease student misbehavior and. time spent disciplining, 

- Decrease student wait time during activities, 

- Increase the amount of time scheduled for academic content areas. 

TO EVOKE M ORE STUDENT ATTENTION TO ACADEMIC TASKS : ~~ 

- Praise students for appropriate behavior, 

- Be "withit", 

- Do more groupwork and provide more direct academic instruction, 

- Provide a variety of academic learning tasks, 

- Supervise academic seatwork activities more closely. 

v 

TO PROVIDE MOR E DIRECT ACADEMIC INSTRUCTION : 

- Increase academic feedback (especially positive feedback), 

- Increase academic questions (especially low-level, convergent questions), 

- Increase academic explanations and demonstrations, 

- Increase academic structuring/directions. 
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TO PROVIDE MORE OPPORTUNITIES FOR STUDENT HIGH TASK SUCCESS ; 

- Become more familiar with students' skills and knowledge, 

- Increase frequency and reg jUrity of classroom testing, 

- Increase direct instruction (especially academic explanations, demonstra 
tions, structuring/directions and feedback to the group), 

- Increase the number of activities in which previously learned material is 
reviewed. 
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SECTION 2 
REVIEW OF THE LITERATURE 

Recently classroom research has explored the relationship 
between the amount of instructional time provided to students and 
;hcir achievement (Fisher, Berliner, Filby, Ilariiavc, Cohen, Doshaw, 
and Moore, 19 7*S ; llarnosch.fop» cr !• i lu>* 9 197!t; and bomax and 
Cooloy, 1 ( .) 7l> ) • Instructional time is defined as the actual amount 
of time teachers provide direct instructional activity to pupils. bomax 
and Cooley (1979) indicated that there is almost universal agreement 
anujiif; studies documenting the importance of instructional time as a 
major variable influencing student achievement. These studies .°u/;.'cst 
the need to examine and perhaps to restructure ;.nu tw reallocate 
the instructional time provided in the elnssro'O,. .;i:icc ;;j. ( :t :*;voiai 
education students usually perform aendemi ca 1 \ y i»-:-i,".v.' iheir ivVM^ed 
levels it is exceediiif.lv important thai v.o provide ; L r;;e ; i \*w that 
is maximally effective and cost efficient . 'ihe field o : *■ i i «\! i.*a t \ on t 
therefore, appears particularly suitable for reso,.r.\: into this ar^a of 
inquiry. - Potentially these investigations could enable special 
education teachers to accelerate achievement rate.; by i.;:provin/. their 
use of instructional time. We will review some of the 
preliminary research findings in this area of inquiry ami discuss 
their implications for special education research and pra .trices. 
Ue I .» l i piuui ip of I us t mot* i nmi i Tim^ and r-irni 

:V\ rarlv a*; I'UiS i\irru|| fonau i .i t ed a i»od>*l • ■ :" i n : ;\;c I « -ui :!'al 
fo.-il, into .ic»-muu! : he re I a I i or sii i i : : u- ' ' ■ :m * I : v a::! 

sliidrni ,icn i evrneiil • Vcordin". (<> Sni'i ii«»nl ( u«- 'iv'.* .if r-.ir.nii.; i 
t i • ? » * • ■ i *»••-. ■ ■ : , * ii*! I i i ■ i j. * ■ ■ r « : ' • \ ■ . - • • ■ ; • * 1 „o 
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Harris a„d Serwor (1966) examined Vc relationship between four 
methods of tench!,,, reading and the roading'achicvemcnt of ,141 
socio.econo.de status (SES) first graders. The contra] fi„d illR 
indicated that the amount of ti»o teachers taught was a more significant 
factor in proving student achievement than the typo of reading approach 
they used. 

* 

Bend and Ovkscra (1907), and Harris, Morrison, Serwer and Cold (,968) 
reported negative correlations between teacher or student absences and 
achievement. This suggests that higher' frequencies of student attend- 
ance is associated with more instructions time and thus correlated 
with higher achievement rates. Carroll and Spearritt (,9„7,,, Ness and 
Takanishi (197..). and Stalling and Kaskowit: (197..) have -assessed 
the amount of instructional ti.no that students actually engaged in 
specific content learning activities. Tnough those results were not - 
entirely consistent, positive associations *crc found between the 
amount of time students spent in instruction and their achievement. 

block and Burns (1975) in a review of mastery learning stU( | ies nlso 
reported a positive relationship betweem the amount of time students 
wore activo.y engaged in learning activities and achievement. Mcbonald 
(1973, studied reading and mathematics achievement" in an elementary 
school and found student inattontivenoss to he negatively related to 
acii i vvement . ' 

» 

"" '" ( ' 1 ' 7 '" ••• Ul « IU -' 1 "I' -vK.ll.mnl, I, tween teachin, s.vlu and 

St '"'*'' ! " '"'" h:V " 'hat re.-ardh,,; of u-aehiu,. stv!e students 

f " 

wh ° :;,KM,t mvv ,irw <-i".,et h.„i ;,,,>,• .,d,icv,,,Mt i, run 

• nil icct . 
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Fisher ct. al. (1977) concluded that the positive relationship 
found between instructional time and achievement in reading and- 
math provided qualified support for the hypothesis that more time 
yields more learning. Thus, the -pattern of time allocation to various 
subject matter areas and subarcas is an important consideration when 
planning and implementing instruction. However, the authors indicated 
that the results, do not explain what must be done during the time al- 
located to a content *area in order to increase the amount of learning. 
• The important point of this' exploratory study according to the researchers 

was that differences in the quality of instruction did not appear to 

overide differences in tne amount' of instruction. 

Policy Studies , 

In a study witlv implications for school policy, Wiley (1973)- 
calculated the average amount of schooling hy multiplying the length of 
the school day by the average daily attendance rate. Using these data 
as an indcVx, a strong positive relationship existed between the amount 
of schooling and knowledge acquisition in obth reading and mathematics. 
David (1974), hfter reviewing 20 studies which examined the relationship 
between exposure to schooling' and' achievement, concluded that, there were' 
consistent positive relationships between exposure to schooling and 
achievement scores. 

Wiley and llarneschfeger (197-1) suggested that achievement is 
directly determined by only two variables:.., total time needed by a pupil 
to learn a task and total time a pupil actively spends on a given 

learning task. These authors contend (hat student achievement could 

. i 

i 
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bo increase without, r^uirin, . refined t cchno,„, ;y of instruction 

Sl " P,y ^ l0 " ,!t "°" inS th ° " th. school day , and a0(lifyinR 

th= distribution of timf all ocat= u to various content areas Curing the 
school day. 

¥ 

Relationshi p of Allocatoj Time and Achievement- 

Uar,,eschfe R er and ,«,e y ( 1978) roportod that .„ 

P °° r r ° aiJCrS ' " aChe " "Hocatcd less time for roadi„ s . 

instruction than in classroom tlla t contained students with nbovcavcr.aee 
reading scores. ,,,rt„cr analysis of the data rcvoa.cd that classroom 
with the greatest number of low achieving pupils also had fewer oppor- 
tunities to learn and to read. I„ ,, rclat0ll stuJy _ llarnoscIlfccor ^ 

Vll0y (m8) jO* <"<Wo in actual instructional time 

provided in a series of classrooms within an urban school district and 
found that some clas.es received the equivalent of „, llays norc lnslructloa 
per voar than other/classes. students who achieved at hi,*., 
levels received as much as 27 percent mere direct teacher instruction 
in basic sUll areas while students in the lower achieving group, had 
27 percent mere unsupervised seatworm The authors concluded that 
althou,.,, pupiu were „sin„ similar materials and receivin s essentially 
equivalent rc.ndin,. proems no one would assume that these pupHs have 
equal opportunities ^-i-o^rM. 

'Hhcr invr.sU,nu,rs ha¥0 ^ 01 , portllllUU , s ^ ^ 

. 'th were denned ,|„. chances provided l„ 
the student. ,„,,rUvel.v res ,„ ;k,,J ■ ,,„,„.,„ material. ,,.,7.,, 

" ;,:, " V1 "' /M-ad,. pup,,, ,,,.„„ ,,„„.,. ; :itv „.,„„„ „ v ,.,. ;li . 

™-e than 2n seconds rn,.n,ed in directed ,cu.li,„. per dav. M .,H. 
Pclanadri and Harris ,10771 reported that ., ,„• rim , ,,,„,„ ,„„„,... 
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spent lea, than eight minutes per day i„ oral or written responding 
activities and that they spent approximately 50% of the cltfss time in 
transition activities. Additional observational data indicated that 
elementary pupils in low income area schools spent less than 5 seconds 
a day working on arithmetic facts. Stalling (1975) highlighted the 
importance of opportunities to learn by reporting consistent significant , 
positive correlations between reading achievement and engagement in 
reading activities. Rosenshine and Berliner (1U78) reported that time 
spent in reading correlated higher with achievement than any other teacher 
or student behavior studied. : : 1 r ~" 



Hall et. al. (1U77) expressed contra regarding the dearth of 
opportunities to learn in classroom* an\suggcstcd four possible • 
explanations which concern special and regular educators who must 
teach lower functioning children. Pirst, teachers may not be aware 
that pupils need to spend ;:,orc time responding in order to learn. 
Second, the eurricular systems employed frequently emphasize activities, 
materials and breadth of coverage rather than time on task, engagement 
time and direct instruction. Third, increased numbers of student 
responses could inundate a teacher with more paperwork unless alternative 
logistical systems are developed. Finally, the authors maintain-that 
school policy and/or classrooms are not engineered ecologically to 
maximize responding. 

I" ncKlition to the research summarized earlier in this paper, 
I'ishcr, Boriincr, r'Uby, Marliavc, Cohen, Deshaw, and Moore (lji: fi ) 
summarized the findings of the lleginning Teacher livaluation Study 
l».T.I;.:i.) an extensive study of teaching effectiveness in basic 
skills at the elementary school level. This study analyzed instruction 
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in reading n,d mathematics in twouty-five second grade classes ami 
twenty-one fifu, 1!r „ U „ cl „«. no* investigators reported that: 
1. "ll.o amount of time that teachers allocated to instruction in 
a particular curriculum content area is positively associated 
"ith learnittg in that content area", thus, other things being equal, 
the more time allocated to a content area, the higher the academic 
achievement, 

2, "The proportion of allocated time that students arc engaged 
is positively associated with learning- students who pay 
more attention learn more. 

3. "The proportion of tine that reading or mathematics task provide 
n high success rate for a student As positively associated with 
student learning. 

Based on these .findings, Fisher, et. ni . (H'78) recommended that 
students spend somewhat more than half their time on tasks they can 
carry out with hi,l, success. Also, for learnin, basic skills in the 
elementary grades, the Stage of successful practice, is particularly 
important so that students thoroughly master concepts and procedures." 

4. "'mo proportion of time that reading or mathematics tasks provide 
a low success rate for a student is negatively associated with 
sLudcnt learning," 

5. "Increases in academic learning time are not associated with decreases 

l^itive attitude toward mathenat ics , attitude toward readin, 
or attitude toward school," 

,;i,W,llV ' :l " tiwr » 'HJcr students and/or students u,« 

: --uii,d .,,,„„, ins , ,. tvn ;| > . in;(Mor 

i 5t - r ^ ; '-'!e of :i;, c at the hi, : n success lev.-l. 
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IMPUTATIONS 

"it- K,.„i,, |)rol)lcms in th0 0( , ucatlo iainsnoara _ 

7 roM80 fro "' tho i,, " ,Mt --»* — *,, JBlllistmors , 0 8pecmc 

classroom practices for teachers. 

t,,at " y rCa " M! ' ti " ,; 11,0 «•«« -nous cl.„„ w „ ctlvltl „ " 

1 " croi,si,,,! t,,u ,orofd - i " *••*••« — u S ,„;,,,, 

r t sd,o °' " y ° a — „ d , iovc ,„ ont , vcls . 

Low to u |)pr „ 1)r ,. ltcl) . . istnicUoiiai ^ in 

t. rc,,e,.ot,«. tencner contract., 

»"-ort,u,nn, y> nt t) , is tirac , <c „ avc „„ .^nUivo co„c lusi( .„ s 
W °" * M »Un, ,,,c„ 

rr ,: " n,i "° • imi au " urt <»»>■ o (|l , sti „„c, 

...uu. rclulil , ll|8truction instrilotionaMy Mivc stujonu 

7 lru to sco, ° m 1 - .« — , t t«t> yt „ 00n ; o( . t , 

.students 1 .» 1 1 i I ; tv m i . 

••"iijcv to .ittcml to various ti-u h. . 

tn.,Ls throughout tho school. Jav. 

,fc; " UC < — ion,,! ti „, ,. csult ln 

" ,C " i '" V0M ' t I—., U,„„ tiMlUu „ ;ll , or 

. — ,.,,,,,„,„,,„,»,, 

« ,,„, ,,„.,„„ , ,, 

' ••»'«■• >,.™,.u, ,,. „,,,,,„,,„.,, . . 
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, ( '' J7 " ) ^ ^ <"<•< «** — ,,i,, s 

" Sk " ,, " CSd, " 0lUrS " « — o,u„ p rof ,,,„, 

.-i» B evidence of Wo „ t „ offBeMi llwovor> wo stju (o 

" 0t ° o, tl ,o„u,a le,,,,,, „ f „ schooi 

Quired to accelerate achieves i„ ))rol , leM 

AMUi0ml to th. fact that „c ,,o not havoan) . 

•"on-Uivo data on the opU.,aI lo „ fi t„ of „, sdl00l 

-cicratc achieve,,,,, «„e Md Vltart (1979) , lskcd ai)i)roxim . itoiv 
-.. U «,. a „ yBil ,„ t e S , froailill!!Mt „ lction is ro , |uirod for in instructj ; niu 

" alV ° StU, '°" t , t0 >™ - -I on ai, a c „io ra „ c „ t tcst l)v tho eiH , 

of third or fifth R rado ? lie don ■ t .really ,;„ 0h , 

A particularly important policy issue concerns the impact of - 
service delivery TO sol , ctl ,, f( „. ^ ^ 

'' CSOl '" C,; ™* S 'T lre «-* ~ to .different local,/ in 

^ " "°" i ~ ti *" 'ti«. This BIMI lhu , l „ 1!stion of Bl , othur 
wo arc actually rcduci,,,; pupil achievement hy utiliti,,,? certain 
delivery systems (;;„„! ami liietl,; 1P 7S ). ' , ' 

*~l („», „as defined learners as "students ,, 0 

have to he tan, 'Jit to e lc t„, m to k , ln ,.„ ,,. cxtQm| , lh<lt ■ 

' l: " lJlCn " ,,tl ' 1 ' " '"^h ,„ t|i|SsroM ' " 

'"«y m,i„ro „i,.,e. ins,, -actio,, in ,„,,,.,. „, 

, '« t ' ,lfl LUL 11 !'.m,lu-; l; ,n,.| |,, nu ,,, ; ,,,, fn 

;h ' ,irV " l: ' ,i,, ' :f ,v - ,! -'" 1 -Mvironnonts, toicWr- hi . , 

' 1 • Ull( '•• ''HI Ikiw to ,n lotMt,. 

:;,UH:l!U: h, ^ ;! ^tnuuion,! U,, .!,,,,- 
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'•'••'■•nine and SUbert (1979) indicated that some of the research 
issues that affect the amount of cng.goU U « ar0 rclat0ll t0 t „ 0 ^ 
of schedules, ori-anization of Aerials. trainin 8 students reeeive on 
independent work hahits, and transition fro,, activity to activity. The 
teacher is also faced with the question of „„„ t0 s „ il|)c mii ,, a „ tai „ 
hi 8 h on B a 8 e,nent rates. Currently there is a dearth of data re R nrdi„, 
optin,™ en„n„e,„ent times. ,„ a stUlly j,,^ t0 incroaso m ^ 
instructional ti,„e .Ucth, Pols a rove, ami Somino'l (1979) found that a 
five-minute increase in readin B instruction ti,„e produced m a rl.ed ' 
increases in the acquisition .and maintenance of si(! ht vocabulary*,,,- 
<.i 8 h school pupils. A prone™ raised, by Mt stluIy , ^ 
can the teacher fit the addition.,, time into his/her schodu.o. One 
solution is to examine the nmouut of instructional time bei„ n provided. 
A second ts to doveiop systems to enab.e the teacher to ,,,.xi„,.-,nv 
utilise jus/her time. A , 1() . hcr KoulJ c „ t , u ||w lltUi? , tioM of ^ 
and tutorinj. systems (Scmel, Cohen, and Kandasu-.w, I9-8) . 

Hosoarcl, also needs to bo conducted rcgardi,,, strntc R ics to sensitize 
teachers to the issue of time. Systems win need to be developed to . 
provide teachers with foodbacl; re ( :ardin n .Location time, instructional 
time, and cn.,n,o,„cnt time (c. f. Semmel, 197..). The question of 
logistics win also have to be addressed in the context of a p„ ssil)lo 

hicrcascil to.u-lu'r wort, lo.hl to .lr.il uif, ..iii,; 

• ll h,, '» -»*■*■ • C 1011:11 papers proilwc-ed 

'*>' 11,0 ! ,l, P>l::. J his coik-c-ii must \n< .; t lulic- I ,„ I 
must by ev.-i liia inl, 
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In summary, a high positive relationship exists between time in "* 
instruction (more specifically engagement time in direct instruction) 

* 

and achievement. The implications for the delivery of services and 
research activities in special education are considerable. 
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SECTION 3 



SUMMARY OF PROJECT ACTIVITIES 

Year 1 Activities 

During the first year, and exhaustive literature search was completed 
to insure the inclusion of all relevant information in conceptualizing the 
observation system necessary to collect the ALT data. Subsequently, and 
observation system was developed and tested. After intensive observer 
training, data were collected in two nearby school districts. Twenty-four 
mildly handicapped students and 22 teachers were observed over a period of. 
several months. A total of 145 full days of observational data were 
collects, each student being observed an average of 40 hours on ei 3ht 
different days. Students were also pre- and attested with an Informal 
Reading Inventory (m) and Sterling Math Test (SMT) . m addition, 

teachers kept daily l 0gs o£ academic acLLvici , s ± 

i iT »:ie ?ortoij o: 

observations. 

Observation System Development 

A variety of extant observation systems and related literature were 
reviewed in the initial development stages. They included systemVby 
Kounin (1970), Fink and Semmel (1971), Marliave, et al. (1977), Maccia 
(1973), Johnson (1979), Joyce (1972), and Medley (1973). In addition, 
relevant .arcs of observation systems previously develoood ,t the Center 
for innovation in Teaching the Handicapped (CITU) (e.g., PRIME , CATTS , and 
CARTLO projects) were considered. Concurrent with this activity was the 
exploration of different methodologies such as category, sign, rating, and 
ethnographic approaches. 

Finally the Academic Learning Time Observation System (ALTOS) was 
adopted from that developed by Marliave, et al. (1977) in the Beginning 
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Teacher Evaluation Study (BTES). The BTES categories and coding 
procedures, while similar in nature to many others considered by the CITH 
staff, were chosen primarily because they would allow direct comparison of 
results in this study to those in the BTES study of normal children in 
elementary classrooms. In addition, reliability and validity data on the 
BTES categories were availaMe from their studies. However, general 
coding procedures on ALTOS were modified and categories were added to 
reflect variables w f unique importance to special education settings. In 
additi^ALTQS was designed for tracking a single target student for an 
entire school day. Since mildly handicapped students- often follow 
individually different schedules, it was considered logistically 
impractical for a single observer to code more than one tar.et student 
(rs) at the xame tina during an entire school day. 

The basic coder decision making procedura in u ,L n , iJu ^ outlined 
in Schema 1. As the observer codes, s/he constructs a booklet consisting 
of three different kinds of coding forms/representing a day of 
observation of asingle target student (TS): 1) Identification sheet,' 
which was completed whenever the TS changed teachers and/or settings; 2) 
Educational activity sheet, which was completed for each different 
activity in which TS was supposed to be engaged; and 3) Real-time coding 
>h.33t. ;hich was conoleted for every activitv vhich required the TS- to 
perform reading or math related tasks. 

. ALTOS identification sheet. This form was completed by the observer 
every time there was a teacher/classroom change for the TS . On this sheet 
identification data were recorded which included date, observer name and ' 
number, teacher name and number, target student (TS ) name and number, 
class type (regular, resource, self-contained, other) and class sizn. 
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Schema 1. 
Flowchart for ALTOS 
Coder Decision Making 



Start day 



1.1.-1.6. Complete a new ID Sheet 
for this TS* and Teacher 



1.7. Write any comments 
and staple together 
this completed 
packet. 



YES 



1. Has the teacher 
changed? 



NO 



2.3. When activity is 
over, finish the 
Educational Activity 
Sheet. 



NO 



2. Has a new TS educational 
activity begun? 



YES 



2.1. Start a new Educational 
Activity Sheet. 



2.2. Does this activity involve 
any math or reading by TS? 



YES 



3. Start Real-Time Coding Sheet. 
Code clock time and behavior(s) 
using real-time categories 
by time-sampling at one- ~ 
minute intervals. 



WAIT 


AND 


WATCH 


1 | 




NO 





3.1. Has current activity ended? 



NO 



YES 




*Note: TS is the target student to be observed throughout the day. 
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These data served to identify to whom the following educational activity 
and real-time coding sheets were relevant. 

ALTOsUducational activity sheet. This form is completed for each 
separate educational activity that is allocated for or selected by the TS , 
excluding transitions. Each activity is defined by a change in the 
curriculum content and/or setting. Here the observer records the time at 
whic'.. the activity actually begins, the number of students engaged in the 
same activity as the TS , the TS pacing (self- or other-paced), predominate 
TS activity(ies) (oral reading, silent reading, reciting, listening, 
discussing writing, other)', task difficulty for TS (easy, medium, hard). 

the TS instructor (teacher, peer, aide, self-instructional materials, ' 
taac.ua* machine/ tutor , or no instructor), predominate instructor 
activity^*) with the T3 (lecturing, discussing, prompting ' ' 
modeling/demonstrating, costing, supervising;,- tne curr^um*, con = ,n: 
(e.g., decoding/phonics, word meaning, reading practice, comprehension, 
addition/subtraction with regrouping, computational transfer, 
fractions/decimals, word problems, science, art, physical education, 
recreation/break, management/procedural, etc.), and time at which the 
activity actually terminated. Allocated time for various math, reading 
and other academic activities was calculated post hoc by subtracting time 
icart-i :r:m time .stooped, nnd transition time rhetw-nn activities) w r < 
also determined by the computer when the observational data were later 
entered onto the computer. m addition , 'observers were required to 
describe in their own word^ the major tasks performed by the TS and 
instructor in the activity, as well as characterise the curriculum content 
•'• 'S.Kl. Furthermore, observers Were able to comment on anv 
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significant events that occurred during the activity, These open parts of 
the educational activity sheet permitted later cross-validation of coding 
categories and the possibility of further qualitative analysis from the 
observer comments. 

ALTOS real-time coding sheet. This was used by the observer, in 
addition to the educational activity sheet, for each activity which 
required Che' TS to perform any reading or math tasks. The purpose of 
real-time coding was to obtain estimates of TS engagement time and types 
of instructional behaviors available to TS . To do this, a point time 
sampling plan at one-minute intervals was incorporated. .. Once a minute, 
the observer codes the current TS move, instructor move , and instructor 
focus. m addition, the observer further describes in his/her own words 
what occurs at each sampling moment. The 3TES categories for student and 
teacher moves and rocus were used for coding at the sa.no ling moments. The 
TS move was coded as either engaged-written, envragea-ora; , sSi ~ a tlid - =overc . 
engaged with directions , not engaged-interim, not engaged-waiting, or not 
engaged-off-task. The instructor move was coded as either academic 
observational monitoring, academic feedback, academic questioning, 
explanation based on student need, planned explanation, 

structuring/directing, task engagement feedback (behavior management), or 
null (no instructor move available to TS). The focus of the instructor 

aove was coded as iither ^ecificallv to the ?s , to the »roun or another 
member of the group which included TS , or null (when the move was also 
null). 

For further explanation of the ALTOS categories and coding 
procedures, the reader is reff erred to the observer training manual in 
Appendix B. 
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Teacher Logs 

In addition to direct classroom observations by trained coders with 
the ALTOS ," participating teachers were asked to keep daily logs of 
academic activities of their target student(s). Each day the teacher 
would record for each academic activity allocated for the TS the academic 
subject area (e.g., decoding/phonics, grammar, spelling, division, 
science), a brief description of the task required of the target student, 
the time at which the activity started and. stopped, the TS success rate 
(high, medium, or low), and a description of the specific materials used. 
Teachers did not keep logs on non-academic activities such as music, art 
and physical education. 

A teacher instruction manual was prepared which provided directions 
for and examples of using the log forms. See Appendix C for'further 
details. 

Achievement Tes ts 

To measure TS learning gains in reading and math, target students 
were to be pre- and posttested. A number of tests were reviewed; those 
selected included the Stanford Diagnostic Reading and Math Tests (SORT and 
SDMT), an informal reading inventory (IRI), and the Sterling Math Test. 
In addition to the standardized tests, the IRI provides measures of oral 
reading rates (correct and incorrect words per minute) and approximate 
reading grade Level. The Sterling Math Test ( S MT ) provides comorehena ive 
timed measures of computational skills and cluency in addition, 
subtraction, multiplication and division. The IRI and SMT were expected 
to be mure sensitive to learning gains than the standardized tests, 
particularly with the mildly handicapped population being studied. All 
four tests were to be administered individually by trained testers. 
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Student Background Information 

In addition to classroom observation, teacher logs, and achievement 
• tests, student background information was gathered from school records on 
the target students. Data on type of student handicapping condition, IQ, 
birthdate, age when special educational services began, type of special 
education services provided, standardized achievement test scores, school 
grades, etc. were recorded from available cumulative folders, after parent 
. permission was obtained. 
Sampling Plnn 

t Project staff contacted school systems in the Indianapolis area and ' 
the Monroe County Community School System in Blooming ton. After meeting 
*ith superintendents and special education directors, two systems were 
wUling co Participate waich had teachers who were in^^ted: Lawrence 

, TOWn8Hi? SC ' n °* U ' in ?««"™«»"« «* ^^roe County ^ooU. Teachers and 
school principaiswere then contacted and informed oc^^^r, o: the 
study. Only teachers .who were willing to participate voluntarily in the 
project were considered for selection in the sample. Those teachers who 
did participate were paid honoraria as « form of compensation for the time 
spent in keeping the student academic activity logs. Once a teacher did 
agree to participate, s/he randomly selected a handicapped student and a 
backup in her/his classroom. Then parent permission forms were sent out 
! ° r ^ ** L * CZ ™ at ^n".- v student was not included in the study unless 
written parent permission was obtained. An additional considerate was 
the other teacher(s) who taught each selected student. For example, for a 
-Aidant who spent time in a resource room and a regular classroom, it was 
necessary for both teachers to agree to participate in order to obtain 
complete full-day observation records and teacher logs. Some initial 
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attrition was unavoidable due to failure to obtain parent permission or 
cooperation from a student's other teacher (s). 

The resulting sample consisted of 24 mildly handicapped students 
(EMR, LD, ED) and 22 major teachers located iji 10 schools in two school 

systems. In addition, observation data were also collected on 69 other 

*• * 

teachers with whom the selected students had minor contact (e.g., art, 
music, gym, and substitute teachers). Three replications of 
self-contained classrooms, six replications of resource/regular classroom 
pairs, and three replications of full-time mainstreamed (consulting 
teacher) classrooms werp represented in the. final 3ample. Obviously, some 
teachers had multiple target students in chair classrooms. Of the 24 
students, eight were in self-contained classrooms, 13 in resource/regular 
classrooms, and three in cm 1 1- trine regular classrooms. Of the 22 major 
teachers, three vera, -self-contained , six were nsource and 13 were r»*ular 
classroom teachers. These numbers reclecc cne :lnai lainni.i uTto* - 
attrition of four teachers who were dropped for various reasons (e.g., no 
parent permission obtained, buddy teacher unwilling to participate, too 
busy to keep, logs, etc.). 
Observer Train ins; 

Observer training occured in two shifts, one for the five 
Indianapolis area observers and one for the four 31oomington area 
o.ierv^rS' . Ml observers had orior elemental" 1 / school teaching experience, 
which was considered an important prerequisite for learning the ALTOS, and 
most had been substitute teaching when hired for the project. 
Approximately two weeks were required to train each groups The train in;; 
consisted of viewing and practice codin.; numerous classroom videotapes 
available from the C1TH tape library, evaluating student work samples tor 
task difficulty, and practice classroom coding. Training continued until 
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all observers obtained acceptable agreement •./Uh the trainers on written 
and videotape criterion tests. In addition, tru|uent reliability checks 
Wftro ptH'form.nl during data collection, where observers wore paired with 
each other or with one <u" the trainers, 
Data Co LI 'at ion 

In Lawrence Township data collection began with trained testers 
individually administering the i:U and SMT to the target students. In 
Monroe County the IRI and SMT were administered as pre- and post tests. 

A total of 165 full days of observational data were collected on the 
24 target students. Teachers kept their logs during the entire 
observation .interval. So* tfeio, on the IRI and SMT oocnrred in „id-„ ay 
in Laurence rownshi, and near the end of May in Monroe County. . 

Observer, ,ore .onired ,ith each oth,r on a rotating ba„U once , ,„e, 

.(or purposes of an nddttionai genarail laiiii:-, . -.Uno- L-— • ., 

ALTOS . Completed coding booklets were checked for errors regularly by the 
project coordinator. Specific observers were notified immediately of any 
mistakes or emissions, which were subsequently rectified. In general, 
coding errors were of a very minor nature and became practically 
non-existent after the first week into data collection. The majority of 
errors occurred in rare or unique situations which were not anticipated 
:irin " • ;3!, - ,rv,jr ^iinin«. It was possible to detect and correct niter the 
fact these errors due to the extensive note-taking chat observers 
performed as part of coding on the ALTOS. 
..Data rhockin* and Cmnuter Entr y 

Prior C „ computer entry all observational records and -teacher lo,; 
booklets „ere carefully checked for ,„is 3il „. data and detectable errors by 
th * Pr0i "' :t °>°« 1 ™**- »«,«r po..ibl.. data „erc rectified „n the 
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basis of corollary ascriptions pro¥ido<1 „„ c „„ fom by ^ 
observers. For cample, it , content code „ns emitted on the ALTOS 

educational , celvlty „, t( thtj 0 „ u , a „„,, Uy ^ , MsUy „„„ 0i „ u „„„ t w 

reconstructed fro- the observer net,,, Wibi„, tha corriclllun content 
and Aerials, the t,rg« student activity, end the notes accompany^ the 
real-time coding. This structured notu-takin V provided valuable 
additional intension which facilitated checking the internal consistency 
of data records. Moreover, at least once a a student was observed at 

the same time that the teacher was recording dill, a ■ 

Lt-LOLciing daily academic activity 

lnt '° rmati0n * SinC " Chfl ^"ntionnl , y ^ m included the in£ . omition 

recorded on the teacher io,s , it was possible to cross-val.ldate "the 

teacher 1o<>« vith the observational data as v»11 Tn h, : 

, 1 ' lb ,/a 1 1 « In tin 3 manner, the 

reliability and valid-, „f ,, a MnclMt U) , iniorMtion ^ 

ascertained. These data 'nil he reportaa u,o„ cmoief.en oc data aaa.vsi, 
now n process. 

• In lieu of key-punching, two extensive computer programs were written 
in BASIC for ALT data entry on the TRS-SO microcomputer available at CITH. 
Program ALTCODE (see Appendix c) permitted a clerical person to enter 
ALTOS data onto the microcomputer. ALTCODE provides prompts for all of ' 
the ALTOS data, and is structured after the three basic types of recording 
:; ' vUitl °".-' --9^ data en diskettes, ALTCODE also Performed • 
further interdai consistency and boundary checkmg as part of the data 

entry, (e.;-,., time' s tar ted .-reutcr chin hi mu . » . j r 

° J ' r Clian tuny stopped for an activity) and 

co.np.rted allocation time, and transition ti,ne automatically. '' ALTCODE also 
provideu an .editor to correct any known data entry rai ,tnkes. Due to the 
•structure and extensive prompting and ehockin, in A MOO OK , data entry 
errors were minimised dramatically compared to those which usually occur 
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in key-punching cards. ALTCODE also provided a printout summary of each 
day of observational data for further scrutiny and checking. Program 
LOGCODE (see Appendix D) permitted a similar data entry function for the 
'teacher logs. i 

A third program was written which summarized the real-time coding 
data for each educational activity (Pro-am ALTSUM) in order to prepare the 
ALTCODE raw data tor transmission via acoustic coupler to the IU computer 
time-sharing system (CYBER 172 and CDC-6600) (see Appendix E). Program 
ALTSUM creaks an 80-variablc record for each educational activity, which 
includes frequencies of joint occurrences of the student X instructor a 
focus codes in the real-time coding data. This type of data aggregation 
permits the analysis of 1 ike 1 Lhoods -of joint occurrence of data codes 
(non-metric temporal .?ath analysis — .-ee ?rick ( 1980)), a procedure 
distinctly different from the usual :or; e t.U ton a L *proo.iuur js hidL:>v<'-j. 

After transmission of data from the TRS-SO to th'e larger computer, 
the data were entered into the Scientific Information Retrieval (SIR) 
system. SIR is a powerful data-based management system which, is extremely 
flexible for manipulation and further aggregation of various data for 
subsequent analysis by such programs as SPSS and BMD. SIR was used 
with all observational data, teacher logs, achievement . information, 
background information, etc., during Years 2 and 3 of the project as 
well, so that combined analyses were possible at the end of the overall 
study. At the end of Year 1, project staff had transmitted approximately 
250,00 data items from the TRS-80 to the CYBER 172 for input into SIR. 
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Year 2 Activities 

Late in the 1980-81 school year, contacts were made with school 
systems eor participation in the Year 2 study. Confirmations were 
received from Monroe and Brown Counties as well as from Lawrence 
Township for participation- in the second year research and teacher 
training study. Due to the substantial number of teachers from the ' 
Monroe and Brown County Schools who.' were interested in participating and 
to the logistical liabilities of including Lawrence Township, the Year 2 
data collection and training were conducted exclusively in Monroe and 
Brown Counties. Once the sites, students and teachers were identified, 
data collection activities were initiated. Criterion-referenced and 
norm-referenced achievement measures in reading and math were ' 
administered, after student background information and parent permission 
forms were collected. Concurrently coders were retrained in the use of 
ALTOS until acceptable observer agreement was demonstrated. Fortunately, 
we were able to employ coders who worked on the project during Year I, 
thus minimizing training time. A total of 21 teachers and 23 students 
participated in the Year 2 study. During the fall semester, each student 
was observed- for an average of 6 days, approximately 2 hours per day in 
reading and math activities only. The Year 2 study was designed so that 
the fall observational data could be pooled with the Year 1 data (using 
SIR, described above), and standardized achievement tests (SDRT and 
SDMT) could be given at large enough intervals to be able to discern 
learning gains, if any. These pooled data served as the basis for design 
of intervention strategies to increase mildly handicapped student ALT 
and achievement. 

Analysis of the results from the poolod data indicated a number of 
factors related to ALT (e.g., direct instruction, group 
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structuring/directing, planned explanations to the group, group 
feedback-see results in the following chapter).- However, the sample 
size wa? not large enough during Year 1 to obtain significant 
correlations between ALT variables and residualized gains in academic 
achievement. Since the relationship between ALT and achievement had been 
supported in studies of normal children (e.g., BTES results), we 
proceeded on the assumption that teachers with greater increases in 
student ALT would also have students with greater achievement gains. 
Moreover, this assumption could be directly tested after the Year 2 
posttest data were collected. 

Individual inservice training conferences were scheduled with 
teachers about a month after semester break, when the observation data 
had been analyzed. Prior to each conference, each teacher was supplied 
with a 'report on the findings to be read beforehand. Individual teacher 
observational data summaries were prepared from the fall observations. 
See Appendix D for a sample data summary. Each summary served as a 
baseline measure of that teacher's behavior and his/her target student's 
behavior on key ALT variables. 

During each inservice conference, a staff member went over the 
computer printout summarizing teacher and student ALT behaviors, so that 
each teacher could compare his/her performance and that of her/his 
students to the general findings. The staff member pointed out specific 
behaviors that the teacher mi*ht increase or decrease in order to 
increase student ALT , given the relationships documented in the ALTOS 
observational data analysis. The teacher and staff member discussed ways 
in which such changes couic made until a satisfactory plan was 
developed. It was understood that the teacher would attempt to implement 
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these changes, and that observational data collection would continue in 
the spring semester to verify whether indeed the changes did occur and 
to see if there was any effect on ALT and achievement. 

Individual follow-up conferences were scheduled about 5 weeks later. 
At this time, a staff member met with each teacher, providing him/her 
with a new printout summary based on ALTOS data collected sincu the 
first conference, so that the fall (baseline) summary could be compared 
to the spring summary. Positive changes in teacher behavior were 
confirmed during this .follow-up conference, and related changes in 

« 

student ALT were noted. The most consistent relationship concerned 
teacher direct instruction and student task engagement. Most teachers 
who increased direct instruction also increased student engagement. 
However, some teachers decreased direct instruction, although we had not 
advised any to do so, and usually this resulted in decreases in student 
engagement. Furthermore, when student engagement increased, student: low 
task success was very likely to decrease or not occur at all. These 
experimental findings tended to support the ALT hypothesis. 

Near the end of the school year, posttests of academic achievement 
were administered. A final inservice conference was scheduled during the 
last two weeks of school, where the teacher was provided both fall and 
spring individual observational data summaries and achievement test 
.results. A staff member discussed these findings with the teacher, 
particularly the validity of achievement test results. One finding 
uncovered during these discussions concerned the 'timing of the 
posttests. Some students were tested so close to the end of school that 
they were not very motivated to do well on the tests, thus resulting in 
test scores which were lower than their teachers thought they should be. 
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Observers (who also did the posttesting) tended to corroborate these 
findings. Although this was not true of all students, nonetheless the 
timing o£ the posttesting was apparently too late (on hindsight). 
Observers also, reported , and this was confirmed by data analysis, that 
towards the end of the school year both teachers and students tended to 
spend less time on academics. Non-academic field trips, special 
convocations and recreational activities tended to occur with greater 
frequency near the end of the school year. 

Nonetheless, regression analyses of residualized achievement gain 
scores and ALT measures did yield results comparable to those in the 
BTES study of normal children. See the following chapter for details. 
Although statistical significance was observed less often than in the 
BTES study, the magnitudes of partial correlation coefficients were 
similar to and often greater than those in the BTES study.. The reason 
for less significant findings can be attributed primarily to a smaller 
sample size (i.e., less statistical power) compared to the BTES study. 

Data analysis continued during the summer months, ending the Year 2 
activities. A number of in-house working papers were prepared which 
summarized different parts of the overall results. Findings from our 
data were compared to those in other past studies to check for 
theoretical and empirical consistency. 

Year 3 Activities 

Considerable time was spent during the first quarter of Year 3 
writing a manual for teachers which summarized the findings in 
non-technical terms and which suggested concrete strategies for 
increasing the academic learning time and achievement of mildly 
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handicapped strudents. Conclusions from other research were also 
integrated into the manual when relevant to some aspect of ALT or 
teacher behavior related to ALT (e.g., Kounin's (1970) findings on 
withitness, overlapping and task involvement; findings on reinforcement 
and feedback; findings on questioning). The manual was intended not only 
for dissemination purposes, but also for use in the Year 3 inservice 
teacher training and "replicat ion study. The basic training paradigm was 
to collect' ALTOS baseline observations, present teachers with 
observation data summaries and the ALT manual, discuss and agree upon 
anticipated changes in teacher behavior, and collect follow-up ALTOS 
observations to confirm effects on student ALT. 

A draft of the teacher's manual was distributed to a group of local 
teachers, principals and university faculty members in education for 
appraisal. Numerous revisions and improvements were suggested by those 
individuals. The manual was revised significantly and distributed to a 
similar group for a new appraisal. Further revisions were made on the 
basis of their feedback. It is noteworthy that later in the year, after 
having received a complementary copy of this manual, an assistant 
superintendent. of the Monroe County School System requested permission 
to reproduce 650 copies of the manual for dis tribution to . teachers and 
administrators. It is also interesting to note that bills have been 
recently introduced to the Indiana State Legislature to increase the 
number of school days per year and the length of the school day. 
Although surely coincidental, it is nonetheless an indication that the 
wod is being spread on the importance of ALT. k recent newspaper article 
indicated administrative concern that the amount of time spent bussing 
special education students not cut into their daily learning time. 
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The Year 3 study was very similar to Year 2, and was conducted 
mostly to see if the Year 2 findings would be replicated. School 
administrators and teachers in Monroe County were contacted in the fall, 
A total of nine teachers and 16 students participated in the Year 3 
replication study.. No achievement tests were administered, since the 
relationship of ALT and achievement had been documented from the Year 1 
and 2 combined results. At the beginning of the second semester, 
baseline observations using ALTOS were begun, so that each stident was 
observed on four to six different days over a six-week period, for 
approximately one and one half hours per day in reading and math 
activities only. Individual teacher data summaries from ALTOS 
observations were prepared and inservice conferences were scheduled 
about mid-semester. The same training paradigm was followed as for Year 
2, except that teachers were provided with the final draft of the 
manual of teaching strategies which influence ALT and achievement. 
Follow-up ALTOS observations occurred during the last half of the 
semester, and similar follow-up conferences with individual teachers 
were scheduled. Results for these teachers and students followed the 
same pattern as those from Year 2. One notable difference between this 
group of teachers and students and those from the previous year was that 
this group was comprised exclusively of regular teachers (grades 1 
through 5) who had mildly handicapped students mainstreamed full-time in 
their classrooms. It should be noted that this delivery system was not 
well represented in Years 1 and 2. 

During Year 3 a related set of activities occurred in parallel to 
those described above. The project director was approached just prior to 
the beginning of Year 3 by the .-uper intende/it of the Linton school 
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district, who had heard of our study and who wanted to improve their 
internal teacher evaluation and inservice training programs. After 
several meetings, it was decided that all the principals and the 
superintendent would be trained by project staff to code on a modified 
version of the ALTOS. An intensive three-day observer training workshop 
was held several week's before the beginning of the school year. One of 
the outcomes of the workshop was a simplified version of ALTOS and ALTOS 
coding sheets. 

The Linton principals then used the modified ALTOS when they 
observed teachers during the fall as part of their required teacher 
evaluation activities. They then summarized their data by hand, since 
there was not enough to warrant use of a computer. These data were then 
presented to observed teachers as feedback, and suggestions were made on 
changes in teaching behavior, based on the general 4LT findings. Project 
staff were invited back to Linton about mid-year to present a summary of 
the ALT and achievement findings to the entire teaching faculty in order 
to give them a better idea of the ba^sis of the new evaluation system. 

Although this activity with the Linton school district was not 
planned during Year 3, it nonetheless indicates a potentially viable 
inservice tefher training methodology which attempts to increase ALT 
and student achievement. 

4 further unplanned activity during Year 3 involved the Monroe 
County School Systems, who requested that project staff conduct an 
inservice teacher training workshop during the spring semester with 
teachers in the system (note— these were teachers who had not 
participated in Years 1 and 2 and were not participating in the current 
study). 
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Finally, at the time of this writing, a number of articles are in 
preparation for submission to special education journals for national 
disseininat ion . 
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SECTION 4 
RKSUT/TS 

The S amp le 

Table 1 shows some features of the sample target students and their 
teachers on whom the results of this study are based. The majority of 
students are male and classified as learning disabled. The majority of 
teachers are regular due to the fact that most target students who spend 
time with a special teacher also spend time with a regular teacher. During 
Year 1 students were observed for 145 days, an average of 6 to 7 full days 
per target student* During Year 2 students were observed for 123 days 
(through January) for an average of 6 days per target student, although 
note that students were observed lh to 2 hours per day and only during 
reading and math activities (during Year 2). 

Project staff contacted school systems in the Indianapolis area, the 
Monroe County Community School System in Bloomington, and the Brown County 
School System. After meeting with superintendents and special education 
directors, three systems were willing to participate which had teachers who 
were interested: Lawrence Township Schools in Indianapolis and Monroe and 
Brown County Schools* 
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TABLE 1 

i 

t ALT Sample Description 



Mildly H a ndicapped 
Target Students* 



Sex 



Handicap 



Delivery System 



Locations 



Main Teachers 



Days of Observation 



(1 
(2 



(1 
(2 

(1 
(2 
(3 
(4 

(1 
(2 
(3 
(4 

(1 
(2 
(3 

(1 
(2 
(3 

(1 
(2 





. N 


Year 1 


22 


Year 2 


21 

Cm 1 




43 


Male 


37 


Femal e 




EMR or MMH** 


12 


LD 


26 


ED 


A 
4 


Other 


1 


Full-time regular 


13 


Mostly regular 


8 


Half Resource 


6 


Mostly Special 


16 


Lawrence Township 


5 


Monroe County 


6 


Brown County 


3 


Regular 


37 


Resource 


10 


Self-Contained 


8 


Year 1 


145 


Year 2 (thru Jam) 123 




268 



(students) 

(students) 
(students) 



(students) 



(schools) 



(teachers) 



(days) 



I 

51.2 
48.8 



86.0 
14.0 

27.9 
60.5 
9.3 
2/3 

30.2 
18.6 
14.0 
37.2 

35.7 
42.9 
21.4 

67.3 
18.2 
14.5 

54.1 
45.9 



^Students' age range 7-13 years, in grades 1-5 

**EMR: Educable Mentally Retarded 

MMH: Mildly Mentally Handicapped 

LD: Learning Disabled 

ED: Emotionally Disturbed ( Emotionally Handicapped) 

Other: Multi-categorical or sensorial ly handicapped 
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Delivery Systems • - 

The Delivery Systems in which our target sfudents were enrolled fell 
into 4 categories: 

1. Full-time Regular ; The target student (TS— the one specifically 
observed) spends his/her time, in the regular classroom just like any other 
"normal" student. In some cases this delivery system Includes the consulting 
teacher model, where a special education teacher provides consultation with 
the regular teacher on educational programming for the target student, although 
the special teacher does not instruct the target student. * In other cases, no 
special consultation is provided for the regular teacher. 

2. Mostly Reg ular: Target student spends 2/3 or more of his/her time in 
the regular class and up to 1/3 of the Lime in a resource room where s/he is 
taught by a special education teacher (or some other specialist). 

h Half Resource : Target student spends between 1/3 and 2/3 of the 

time in a resource or self-contained classroom. The remainder of the time 
is spent in the regular classroom or other, mainstream settings. 

4. Mostly Special: Target student spends more than 2/3 of the time in 
a resource and/or self-contained class. TS may be mainstreamed in non- 
academic activities such as art, music, or physical education. 

Note that these fractions ,of time spent in various settings are based on 
those activities provided which require TS reading or math related tasks. 

,4 

The following abbreviations of types of service delivery systems will 
h : used to save space? in presentation of results: 

/ 

D t 1 1 i v o r v S v r> t cms ■ 

FR: Full- Lime Regular 

* 

t, 

MR-G: Mostly Regular, in the regular classroom 
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♦ * 

MR-S: Mostly Regular, in the resource classroom 

i 

HR-G: Half Regular, in the regular classroom . ' 

HR-S: Half Regular, in the resource classroom 

MS: Mostly Special 

OA: Over all delivery systems 

Results: Table 2 

— — i ■ i ■ ■ ■ ■■■ t 

During Year 1 only, TS's were observed for full days. The numbet of 
activities (NACT) averaged between 16 and 19 per day across the four 
delivery systems, with no substantial differences among delivery systems. 
Transition time between activities (TRANTIM) averaged about 3/4 of an hour 
per day or about 2 1/2 to 3 minutes between each activity, again with no 
substantial differences among delivery systems. This is somewhat surprising*, 
since we expected that the MR and HR delivery systems would have more 
transition time due to movement back and forth between regular and resource 
rooms. Apparently, TS f s make the transition between rooms only twice per 
day (i.e., they attend the resource room once per day), and these are just 
2 out of 15 transitions per day on the average. Thus, even if these 
transitions are slightly longer, their effect is washed out by the larger 
number of other transitions. 

Length of school day (LDAY) varied between 5h .and 6h hours 'among the 
delivery systems, with an OA average of 5 hours 50 minutes. Differences 
here may be attributed to 2 factors: The school systems included in the 
study had differing lengths of school days and each system tended to represent 
only 2 of the 4 delivery systems in Year 1. One school system represented 
the bulk of the observations ot* MR and MS delivery systems during Year I and 
its school dav was observed to actually begin and end (in terms of educational 
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activities provided) at 8:30 a.m. and 2: 00p.m. in most of its schools. 

In addition, several of their resource teachers declined to permit observations 

in their rooms shortly after the study began. Since the TS's typically 

went to the resource rooms during the last period of the day, observers 

stopped coding at that point. Thus, these situations produced artifically 

low LDAY times, which were computed from DASTOP-DASTART (observing). This 

also explains the large standard deviation for MR. 

Percent of transition time (PTRAN) relative to LDAY averaged 12-13% 
across the delivery systems. PTRAN in this study was slightly less than 
transition time in the BTES study of normal children in grades 2 and 5 
(about 15% of the time). 

In summary, it would appear that switching of class type in the split 
delivery systems (MR and HR) , does not add to overall transition time per 
day; or, in other words, switching classes once per day does not significantly 
detract from time available to allocate to academics! when comparing the four 
special education delivery systems. 

It should be noted that it was not practical to estimate TRANTIM during 
Year 2, since observers specifically coded for 1-2 hours per day' per TS only 
when reading/math activities were scheduled and these were often non-contiguous 
due to observer scheduling complexities and sampling considerations. 
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Year 1 Full-Day Observations: ALTOS Header Statistics 
Per Day by Delivery System 



* { 



Ml: MM 





1 K 


MR 


VARIABLE 


FULL-TIME 

ft r pi i i a 

REGULAR 
(N°17) 


MOSTLY 

REGULAR 

(N=59) 


.... KACT 


18.2 (3.3) 


15.5 (L V) 


— DA START 


8:29 012) 


8:35 (:36) 


DASIQE 


2:53 (:08) 


2:11 f s 5.1) 


TRANfTM 


0:46 (:1.7) 




I.DAY 


6:37 (:16) 


1 5:34 (1:05) 


PTRAN 


12.0 (4.5) I 


13.4 (5.4") 



HR 



MS 



OA 



HALF REGULAR 
HALF SPECIAL 
(N=14) 



.18.8 (3.7) 



8:26 QQ9) 



.2:51 (:05) 



0:48 (:17) 



MOSTLY 

SPECIAL 

(M8) 


OVERALL 
(N=145) 


15.9 (S.?) 


15.7 (5.2) 


— S..-37 (;14.) ! 


8:35 (:26) 


2:23 (:36) 


2:24 (:43) 


0:44 (:26) 


0:46 (:22) 


5:47 (:42) 


5:50 (:52) 


12.6 (7.7) I 


12.9 (6.1) 




EWC'"'" ' 1 ° r Analysis is a Day of Observnli 
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Results: Table 3 

Table 3 summarizes the variables on the ALTOS identification and 
educational activity sheets for reading/math activities only in each 
Delivery System (i.e., all other types of activities were excluded for 
this analysis). Note that educational activity was used as the unit 
of analysis here; the means represent average scores per activity in 
reading/math and the percentages reflect the percent of activities 
observed within each Delivery System class type where those variables 
were observed. Note also that the MR is split into MR-G and MR-S and 
likewise HR into HR-G and HR-S, so that location of activities (CLTYPE) 
was also used as a cutting variable in these two Delivery Systems. 

Class size (CLSIZE), or number of students present, of course, 
('infers substantially when comparing Delivery Systems. In regular 
classrooms an average of 23 to 25 students were present, whereas in the 
special settings about 5 to 9 students were present. Since smaller 
classes have been found to be positively associated with greater 
achievement gains, these differences should be kept in mind when interpreting 
subsequent results in these settings. All othe#» things being equal, 
the special education teachers should have more opportunities for individual 
academic contacts with TS's and provide more individualized instruction, 
since they have only 1/4 to 1/3 as many students to tench at any given 
time, compared to regular teachers. As will be discussed below, these 
relationships tend to be borne out in the data. 

Likewise, the number of students in exactly the same activity as 
"TS (N STUD SAM) , also parallels the tread of CLS1ZK differences. About 1/2 
to 2/3 of the class are doing the same activity as TS. Individualization 
of instruction can be estimated here by dividing N STUD SAM by CLSTZE 
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TABLE 3 

Teacher and Target Student Educational Activity Descriptions 

by Delivery System* (Reading and Math Only) 
[.Means and (Standard Deviations) OR Percent of Activities] 



FR 



MR-G 



VARIABLE 

>:i six?: 



FULL-TIME 
REGULAR 
(N=307) 



MOSTLY 
REGULAR 
REGULAR 
(N=479) 



MR-S 

"moTTlv 

REGULAR 
RESOURCE 
(N«77) 



HR-G 



HR-S 



MS 



HALF RESOURCE 
REGULAR 
(N-78) 



vi'j'ljDSAM 
i MAI. 1.0(1 



IT. PACING 



JTIIFK-PAiTD 



rSACT 1-1:. L 
■>. : Ul. 



IM :\l> I .._w 

:!'/'iTi:;>: 



)isci:ss 



K! n:.(; 



.TA'iT 2- 



:n<i 



7 



• i.:iTi::; 



7. A 



8.2 



4 . 4 



36.8 



11.5 



I, I i 



').() 



3.3 



'.6.7 



1 '3.9 



8.5 



16.2 



3.3 



28. 3 



2.6 



22.9 (7.0) 


25.1 (4.0) 


5.4 (6.3J_ 


. 12.4 (9.9) 


15.3 (10.8) 


2.1 (3.9) 


17.0 (13;0) 


16.7 (11.3) 


. 12.2 (6.7) 














57.5 


57.3 


51.9 


42.5 


42.6 


48. 1 


— , 








— . 




5.9 


4.2 


15.6 


27.0 


1 9 . 9 


23.4 


3.6 


5.2 


23.4 


18. 1 


20.7 


9.1 


1.0 


.6 




3 5 . 9 


43.5 


26.0 


8.5 


5.9 


2.6 



14.3 



14.3 



16.7 



4.8 



40.5 



2 3.9 (2.9 ) 



9.5 



1 8.0 (9.7) 



liU-JLi!L_D 



4 5.5 



2.6 
29.5 



48.7 



HALF RESOURCE 
RESOURCE/ 
SPEC IAL 
(N=103) 

7.2 (3.7) 



OA 



3-1 (4.5) , 



13.7 (11.9) 



56.4 



43.6 



15.5 . 



.3 



8.7 



12.6 



5.1 



37.9 



3.6 



28.6 



3.6 



2.9 



10,6 



ye. 



5.5 



14.3 



3 . 6 



2K4 

1 , 25.0 



10.6 



6.4 



2. 1 



40.4 



4.3 



MOSTLY 
SPEC IAL 
0M73) 



OVERALL 
(N=1546) 



9.3 (4.3) 



3.3 (3>3) 



14.6 (10.6) 



70.9 



29. 1 



11.7 



24.8 



4.2 



8.7 



.8 



42.2 



7.4 



4.1 



14.1 



11.8 



6.4 



.9 



53.6 



9.1 



17.5 (9.3) 



9.7 (10.0) 



15.7 (11.4) 



61.1 



38.9 



8.2 



22.9 



5.6 



15.6 



.7 



40.4 



6.6 



5.6 



23.1 



10.4 



ON 
-•J 



10.5 
2.4 



39.5 



7Ei 



8.4 



J 



TABLE 3 (cont'd) 



VARIABLE 

n;sTACT 1-1 m 

IJ'.CTlHUN'n, 



FR 



[Means and (Standard Deviations) OR Percent of Activities] 
MR-G MR^S HR-G " HR-S 



iiiiscussTacL 

' !'ROMfn;:n 



ii:sti:.v; 



SMPKRVISl.NG 



OTilF.R 



FULL-TIME 

REGULAR 
(M=307) 



juSTArr 2- 2nd 

i.f.cti.ri.'.t; 



jiTS_i:K5;si:.v; 
PKO.Mi'Tl.'.T; 



Monri.i:;,; 



tgstinc; 



siTERVisi:;rj 



OTHER 



'ASKDIl'F 



llAi::. 



ERIC\ 



3.0 



3.0 



22.0 



5.6 



4.6 



56.6 



5.3 



8.7 



13.7 



A3. 7 



21.2 



2.5 



3.7 



6.2 



49.0 



17.7 



13.2 



MOSTLY 
REGULAR 
REGULAR 
• (N=^79) 



JlJL 



22.3 



.4. 8 



3 4.7 



.18,1. 



7.2 



12.0 



_25^5_ 



12.6 



1.8 



3.'».3 



2.4 



34.7 



56.6 



8.7 



MOSTLY ' 
. REGULAR 
RESOURCE 
(N=77) 



2.6 



50.6 



2.6 



14.3 



23 . 6 



1.3 



7.7 



15.4 



38.5 



15.4 



7.7 



15.4 



45.4 



46.7 



7.8 



T 



HALF RESOURCE 
REGULAR 
(N-78) 



1 UZU]±' , 



HALF RESOURCE 
RESOURCE/ 
SPECIAL 
(N=l 03) 



6.6 



7.9 



21.0 



7.9 



9.2 



44.7 



2.6 



10.0 



13.3 



/.3.3 



20.0 



13.3 



43.5 



48.4 



8. 



BaiDttUMWII 



4.8 



3.9 



30.1 



2.9 



9.7 



44.7 



3.9 



2.6 



10.3 



39.0 



12.8 



12.8 



2.6 



44.8 



46.9 



8.3 



MS 



MOSTLY' 
SPECIAL 
(N=473) 



2.3 



1.5 



27.4 



3.0 



7.9 



51.7 



6.2 



2.7 



4.8 



46.9 



11.6 



1.4 



26.5 



6. 



39.3 



49.6 



11.1 



OA 



OVERALL 
(N=15'»6) 



4.0 



3.1 



25.9 



4.3 



8.1 



45.5 



9.1 



5.8 



10.1 



40.4 



14.9 



1.7 



23.0 



4.1 



40.7 



48.9 



10./* 



00 



77 



0 



TABLE 3 (cont'd) 
[Means arid (Standard Deviations) OR Percent of Activities] 




TABLE 3 (cont'd) 



[Means and (Standard Deviations) OR Percent of Activities] 



1ERJC 





MR-G 


MR-S 


HR-G 


HR-S 


MS 


OA 


_^MIADLE 


FULL-TIME 
REGULAR 
01=307) 


MOSTLY 
REGULAR 
REGULAR 
(N =/ <79) 


MOSTLY 
REGULAR 
RESOURCE 
(N=77) 


IALF RESOURCE 
REGULAR 


liALr KtbOURCE 
RESOURCE/ 
SPECIAL 
\ N = 1 0 3 J 


MOSTLY 
SPECIAL ' 


OVERALL 


COa'i'HNT O.ont 
















*.!)D/siii'. ::o 


4.2 
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•MiI)/si:h kc;p 
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3. 6 
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.8 








• I 


1 . 1 


i'LAi'.K VAI.UK 
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.4 


__ 




1 0 
J . V 


/ 

. . 4 


1 .4 


: r \.\ \ v\ k atio: 


3.3 


6.5 
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0 , 0 


/. /. 
4 . 4 


c , 


i)i VISION 


6.2 


7.5 




2.6 


1 0 


1 Q 




i'KA(:ri«>:.7iirc. 


•',.9 


2\1 








• D 


1 . 8 


SPATIAL Al'PI. . 


3.3 






5.1 




A 
• 4 


1 .0 


.:o:<n pkohs. 


.3 


2.5 


1.3 


2.6 


1 Q 




1.6 


. IATII-RKI.ATKI) 


8.8 


5.0 


3.9 


7.7 




4 • 0 


5.5 


•:ath iw'.f.nv: 


.6 


.4 








1 n 


1 . ? 






28. 7 


u.? | ■/;.; 








'•<:i r:;n; 


2.3 


1 . 7 




1 .3 




Q 
. O 


1 . 3 


'''■■-AM. ST. 


4 . 2 


7 . 7 




11.5 


1 n 


/ 

. 4 


4. 1 


oh. i.a::. :. 


1 








, 










• / 




L". ,'»' 


1.0 


.2 . 


^ 1 
i). '/ 


'.P'l 


— 












. 1 


•:rsrc 


— 


.2 










. 1 


il'Cil. ARTS 




— 






















.. 




i'K:-;n:iT. :»i:v. 






1.3 




1.0 


1.3 


. 5 


ICT./I'KOC, 


.3 


.2 








.2 


.2 
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- 1 - 


1 .0 
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(and subtracting from 1 so that a higher score represents more individual- 
ization of instruction)— e.g. , for FR, individualization = 1 - (12. A/27. 9) 
= .46. The following individualization scores obtain: 

Ave. Degree of Individualization 
Ave. CLSIZE Delivery System Per Activity 

22.9 FR , 46 

25.1 MR-G .39 

5. A MR-S | 61 

23.9 .HR-G .25 

7.2 • HR-S .57 

9-3 MS .65 

As can be seen, about 1.5 ro 2 times more individualization occurs in the 
smaller special class settings relative to the larger regular class 
settings. (Degree of individualization is more directly measured in Table A 
by^the real-time coding category: TSFOCUS). There appears to be an 
obvious trend between decreasing class size and increasing individualization 
of instruction. 

Average amount of time allocated (171ALL0C) per reading/math activity 
... across all Delivery Systems is about 16 minutes. It appears that the 
MR-S has somewhat shorter activities (12 minutes) on the average than 
do the other Delivery Systems, but the standard deviations are fairly 
large relative to the means. 

Target student pacing (TSPACING) was coded as either self- or other- 
paced for each activity. Over all reading/math activities 
across all Delivery Systems, about 61% of the activities are self-paced 
and 39% are other-paced, or about a 3:2 ratio of self- to other-pared. 
Notable exceptions to this pattern are the MR-S (about 1:1) and MS 
(about 7:3). it appears that fewer sell-paced activities occur in MR-S 
and more self-pacing occurs in MS DeliveLy Systems. Another wav of 
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^interpreting this is that MR-S teachers do more group wo#k with very small 
groups (see above), and MS teachers do less group work, compared to 
regular class teachers (FR, MR-G, HR-G). 

Looking at the predominant TS activity (1st) (TSACT1) over all ^ 
Delivery Systems, writing is most predominant in about 40% cf the 
activities, silent reading in 23%, and listening 'in .16% of the reading/ 
math activities. IS oral reading occurs 2 to 3 times more often in the 
MR-S, HR-S, and MS Delivery Systems. TS reciting occurs 5 to 8 times 
more frequently in the MR-S compared to regular class settings, TS 
listening is not as predominate in Qhe special settings (MR-S, 
HR-S, and MS) compared to regular classes- The least amount of writing 
occurs in the MR-S. 

For the second most predominant TS activity (TSACT2) over all 
Delivery Systems, writing occurs as second most predominate in about 
402 of the activities, silent reading in about 23T M andVm:iting and 
listening each in about 10% of ^;he reading/math activities- Again, 
a similar pattern obtains when comparing Delivery Systems for the second 
most predominate TS activity. More activities in the special settings 
require T$ oral reading and reciting, compared to the regular settings. 

Looking at page 2 of Tpble 3, the first most predominate instructor 
activities (INSTACT1) over all Delivery Systems were supervising (46%) 

and prompting (26%). Nofcably more prompting occurred in the* special 

/ 

settings, especially MR-S , compared to regular classrooms. In addition, 
the MR-S teachers tested more often and spent less Lime Supervising, 

Tlu! second most predominate instructor activities (1NSTACT2) over 
all Delivery Systems were prompting (40"), supervising. (230 and 
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modeling/demonstrating (15%). Prompting was most likely as the 2nd 
predominate activity in the HR-S and least likely in the MR-G. Again, 
testing was more frequent in the MR-S. 

TS task difficulty (TASKDIFF) over all Delivery Systems was coded 
as easy (high success) on 41% of the reading/math activities, medium 
(medium success) on 49%, and hard (low success) on about 10% of the 
activities. These results are somewhat different than those found in 
the BTES study of normal children, where about half th^activit ies were 
easy^ half were medium, and less than 1% were hard. Compared to normal 
children, mildly handicapped children experience high t, k success less 
often, and low success more often. It should also be noted that the 
Delivery Systems represent TS ! s of varying learning ability. The most 
capable T3 \s were likely to be in FR and MR settings, whereas the least 
capable weife. likely to be in the MS setting. This may explain why more 
high success was experienced in the FR Delivery System, although those 



oame students also experienced the most low task success as well. Also 
noteworthy is that MR-S students experience more high success in their 
resource rooms, compared to their regular class experiences. 

On page 3 of Table 3, it can be seen that the TS instructor 
(TSINSTI)* was most often the teacher (66%) or no instructor (26%) in 
reading/math activities across all Delivery Systems. No instructor 
means that TS had no direct contact whatsoever with an instructor 
during the entire activity. * 

The primary CONTENT (subject matter) in the reading/math activities 
(iocs differ across the Delivery systems. The resource teachers (MR-S and 
1IR-S) provided relatively more reading and less math activities .than did 
the roV.ular (FR, MR-G, HR-(I) classroom teachers, which indicates obviousl 
that. TS's in those delivery systems were most deficient in thei r reading 
sails compared to their math skills. 




74 



Results :j Table 4 

In Table 4 instructor and TS behaviors in reading/math activities 
are presented. /These measures are taken from the real-time coding sheet' 
and estimate the average percent time -spent in the various categories of 
behavior in the delivery systems. Single TS,' instructor and focus variables 
are given first, combinations of TS x instructor x focus next, and then some 
composites are presented at the end of Table 4. 

TS behaviors . Over all delivery systems, target students spend the 
majority of their time engaged-written (EW— 26%) , engaged-covert (EC — 27%) , 
not-engaged off-task (NO — 17%) and engaged orally (EO— 13%). Note that 
TS oral engagement is 2 to 3 times higher in the special settings (MR-S, 
HR-5 and MS) compared to the regular classrooms (FR, MR-G and HR-G) . As 
discussed above, more oral reading and reciting occurred in the special 
settings. Less EW also occurred in the resource settings, and the least 
amount of off-task behavior (NO) occurred in the MR-S. NO is somewhat 
higher in the FR and HR-G delivery systems. 

Instructor behaviors . The most predominant instructor move was null 
(NU) , meaning that 60% of time no direct instruction was being provided to 
TS or to a group which included TS*. This is consistent with the fact that 
about 60% of the educational activities were self-paced (i.e., independent 
seatwork). Of particular note, the MR-S teachers were engaged itj non-direct 
instruction of TS or his/her group only 43% of the time; or in other words, 
much more direct instruction was provided to TS\s in MR-S rooms. 

Mor,e academic monitoring (AM) occurs in the special settings (MR-S, 
HR-S, and MS) compared to the regular classrooms. Likewise more academic 
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'"'Mote that if the instructor was providing direct instruction to another 
group that did not include TS, NT was coded. . 

« 
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Teacher and Target Student Behavior by Delivery System 
in Reading and Mathematics Activities Only (1643 activities observed): 

[Mean Percent Time (Standard Deviation)]* 



VARIABLE 

t.-r i 



FR 



MR-G 



^2. 



FULL-TIME 
REGULAR 
(N-13) 

_26.2 (9.6) 



MR-S 



3.7 (5.3) 



l'.r; 



28.8 (10.2) 



!•;!) 



8. r.v 



7.2 (1.8) 



5.0 (1.8) 



4 • 5 (3.8) 



19.6 (10.5) 



li_AM 

r m. .\V 



1 I . AO 



12. 



13. XI' 



64.7 (10.5) 
0.5 (0.6) 



11.8 (4.9) 



7.8 (3,9) 



3.4 (1.8) 

1*— — — — — 

3.3 (2.9) 



MOSTLY 
REGULAR 
REGULAR 
(N-8) 



28.6 (8.1) 



8.1 (3.3) 



32.5 (5.2) 



7.7 (2.6) 



3.4 (1.9) 



5.2 (4.3) 



1^.5 (9.3) 



HR-G 



MOSTLY 
REGULAR 
RESOURCE 
(N-8) 



HR-S 



HALF RESOURCE 
REGULAR 
(N-6) 



MS 



2L9 (7.5) 25.9 (11.3) 



M.3 (11. U 4.4 (1.2) 



26.2 (12.3) 35.6 (13.9) 
5.4 (2-6) 6.1 (1.7) 



5-4 (3.1) 3.2 (1. 3) 



,7.7 (6.Q) 



JL-LllLil 



14. SP 



'15. IF 



16. ::iiro>:i;s 
j 7. ts Fiirrs 



7.1 (2.0) 



1.3 (1.2) 



64.8 (10.5) 



11.9 (4.8) 



(11.1) 



56.5 (10.7) 


43.5 (19. 2^ 


1.9 (1.7) 


4.5 (6.'i) 


11.4 (4.1) 


27.6 (11.7) 


11.1 (4.7) 


14.5 (12.7) 


3.8 (2.3) 


2 . 6 (2.1) 


6.1 (3.6) 


1.8 (1.6) 


7.9 (2.6) 


,4.9 ( 1 .9) 


1.3 (1.2) 


0.6 (0.6) 






. " ,r '-5 (10.8) 


43.5 (19.2) 


_10.0 (4.4) 


. 32.9 (18.5) 


33.4 (11.1) 


. 16.7 (16./,) 



ilLJLiioai 



-5H.JLIi7.iiL 
— lLJ2.iil_0L 

J4^8_X5^1L_ 



HALF RESOURCE 
RESOURCE/ 
SPECIAL 
(N=6) 

,21. 7 (8.2) 



OA 



MOSTLY 

SPECIAL 

(N»16) 



17.8 (7.3) 



29.2 (6.8) 



5.5 (2.8) 



3.5 



(2.3) 



28.4 (9.2) 



OVERALL 

(N=43) 



16.0 (7. 11 



21.4 (6. 8) 



6.9 (2.6) 



5.8 (2.9) 



16.5 (15.1) 



5.2 (2.5) 



26.3 (8.5) 



12.6 (6.1) 



-2.7.2 (9.H 



—7.0 (2.2) 
_4.5 (2.1) 



6.5 (4.2) 



,9.5 (6.61 
5.4 (2.5) 



5 8.6 (21.3) 



.16.5 (9.3) 



3) 



6.6 (1.4) 



1.2 (0.7) 



J0 L 2 . (7.6) 



15.6 (8.9) 



.59.1 (12.1) 



_5,„7. (3.4) 
16.7 (9.5) 



2.2 (1.4) 



-1.3.9 (5.5) 



3-7 (2.6) j 3.1' (2 .2) 



60.0 Qui . 



1.6 (1.6) 



14.0 ( 5.2) 



,9.9 (5.1) 



1.6 (2.7) 



3.5 (2.1) 



5.6 (2.7) 



1.1 ( 0.8) 



6.9 (3.3) 



58.6 (21.3) 



2A (3 ' 2) ! 

7.0 (2.3) 



6.7 (2.8) 



2.7 (1.8) 



JiiLiiLiL _27^_xio.o) 



59.1 (1 2.1) 



1.9 (1.5) 
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19.4 (9.9) 
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Ui 
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FR 


VARIABLE 
19. KNAMTS 


FULL-TIME 
REGULAR 

■ • »• n w unit 

(N«13) 
0.3 (0.2) 


20. WAITS 


4.8 (3.2) 


_2_1. ENAQTS 


2.8 (1.9) 


22. r.:;>::ns 


1.4 (1.0) 


23. F.MXPTS 


0.1 (0.2) 


2't. i::;soi.s 


1.6 (0.8) 


25. r- :.i iTS 


0.2 (0.3) 






26. :; KAMrs 


0.02 (0.09) 


27. NKAF'i .i 


0.14 (0.36) 


J28. :;kaots 


0.00 (0.00) 


29. ;;i:.\:;ts 


0.00 (0.00) 


30. ::i:xi>is 


0.00 (0.00) 


31. Ni'SDTS 


0.00 (0.00) 


32. • rs 


0.61 (0.63) 




34. i:::.m v.ji 


0.14 (0.35) 


6.r,.<i (4.33) 


35. i;::.v~ 


4. 58 (2.9 5)1 


36. !.:.: >t .(;K 

37. r.:;>::"(; ; : 
3B. K.'.'Si-cK 
39. r.KTiv.K 


1.89 (1 .80) 


3.0 7 (2.70) 


5.2') (2.06) 
0.41 (0.4 5': 



TABLE 4 (cont'd) 
Mean Percent Time (Standard Deviation). 



MR-G 



MR-S 



HR-G 



MOSTLY 
REGULAR 
REGULAR 
(N-8) 



MOSTLY 
REGULAR 
RESOURCE 
(N-8) 



0-.5 (0.6) 


2.9 (2.7) 


4.2 (1.8) 


19.9 (11.8) 


2.4 (1.1) 


10.6 (8.9') 


1.3 (0.9) 


1.6 (1.6) 


0.03 (0.05) 


0.6 (1.0) 


0.6 (0.5) 


2.7 (1.8) 


0.4 (0.4) 


0.04 (0.12) 






0.00 (0.00) 


0.09 (0.25) 


0.10 (0.12) 


0.68 (1 .22) 


0.06 (0.11) 


0.09 (0.25) 


0.0.' (0.02) 


0.00 (0.00) 


0.00 (0.00) 


0.04 (0.12) 


0.03 (0.07) 


0.09 (0.23) 


0.45 (0.68) 


0.44 (0.61)| 






1.19 (1.3) 


1.46 (.3.87) 


6.71 (2.8) 


7.02 (10.3.3) 


8.05 (4.1) 


3.87 (4.57) 


2.40 (2.1) 


1.01 (1.67)1 


5.78 (3.4) 


1.11 (1.72)1 


6.99 (2.7) 


2.04 (2.50)1 


0.24 (0.24) 


. 0.00 (0.00)1 







HALF RESOURCE 
RESOURCE 
(N=6) 

uro nauca c ob vemn 

0.00 (0.0) 



2.7 (1.2) 



1.4 (1.6) 



_0.9 (0.6) 



0.2 (0.5) 



0.6 (0.8) 



0.4 (0.3) 



HR-S 

HALF RESOURCE 
RESOURCE/ 
SPECIAL 
(N-6) 

1.9 (3.3) 



MS 



OA 



MOSTLY 

SPECIAL 

(N=16) 



10.2 (5.8) 



5.1 (2.7) 



2.9 (3.0) 



0.06 (0. 14) 



1.9 (1.4) 



11.2 (4.1) 



6.6 (4.3) 



2.2 (1.9) 



3.6 (3.3) 



0.55 (0.52) 



0.00 (o.o o) 
0.00 (0.00) 



0.00 (0.00) 



0.00 (0.00) 



0.00 (0.00) 



0.07 (0.18) 



0.67 (0.61) 



0.00 (0.00) 



1 1 .»9 (5.69 ) 
7.57 (5.7) 



3. f ) 9 (2.0 7) 
4.90 (4.10) 



— 1 O'M ) 
0.09 (0.22) 



.0.00 (0.00) 



,0. 14 (0.35) 
0.00 (0.00) 



0.00 (0.00) 



0.00 (0.00) 



0.00 (0.00) 



0.24 (0.29) 



0.23 (0.33) 



3.0 (2.2) 



1.1 (1.0) 



0.02 (0.09) 



0. 16 (0.39) 



0.03 (0.11) 



0-00 (0.02) 



0.00 (0.00) 



0.09 (0.34) 



1.20 (1.37) 



0.74 (1.81) 0.21 (0.35) 



IdLS^dll 2.4 5 (2.89) 
3.49 (3. 64) 
0.90 (1.68) 



J±t2LSfLll) 

1.50 (2.68 )1 1.83 (2. ')9) 

1.80 (1.4 7 ) 3.58 (2.02) 

,0. 16 (0.28) 0.15 (0.30) 



OVERALL 
(N=43) 

1.2 (1.2) 



7.9 (4.2) 



4.6 (3.4) 



1.8 (1.4) 



0.2 (0.3) 



| 2.1 (1.7) 



0.6 (0.7) 



0.02 (0.07) 



0. 12 (0.30) 



0.02 (0.08) 



0.00 (0.01) 



0.00 (0.01) 



0.04. (0.21) 



0.81 (1.00) 



0-37 (0.69) 



5.71 (4.45) 



5.04 (3.55) 



1.59 (1.69) 
2.84 (2.6Q) 
4.72 (2.22) 



-J 

<2h 



0.23 (0.31) 89 



TABLE l\ (cont'd) 



ilean Percent Time (Standard Deviation) 



FR 



MR-G 



MR-S 



HR-G 



HR-S 



MS 



OA 



VARIABLE 

4o. ::i:a::(.r 
M. ::kafck 



'(2. IIFAnc.U 



'13. r;rc:w.R 



:;k:>!»:r 
'16. rcn 



'18. ;;;:a:;>: 



49. 
50. 



kL-li-LiiL 1 !!!! 
54. 



55, 



[".6. :;i dk;r_ 
57. :;:••;)! 



FULL-TIME 
REGULAR 
(N=1 3) 

0.03 (0.06) 



0.16 (0.25) 
0.4 3 ( 0.64) 
0.15 (0.31) 



0.13 (0.26) 



0.09 (0.28) 



0.24 (0.28) 



37.6 (12.3) 



27.0 (10.1) 



71.0 (10.4) 



29.1) (10.4) 



35.3 (10.5) 



(5.0) 



22.1 (10.0) 



33.2 (9.9) 



Hill CO. 73) 
1.22 (1.51) 



2.01 (1.73) 



MOSTLY 
REGULAR 
'REGULAR 
(N-8) 



0.20 (0.26) 



0.44 (0.88) 



0.54 (0.52) 



MOSTLY 
REGULAR 
RESOURCE 



HALF RESOURCE 
RESOURCE 



0.00 (0.00 ) 



0.00 (0.00) 



0.00 (0.00) 



0. 11 (0.24) 


0.00 (0.00) 


0.27 (O.jO) 


- 0.00 (0.00) 


0. 27 (0.33) 


0.00 (0.00) 


0. 24 (0.13) 


0. 16 (0. 43) 




a 


36.2 (13.4) 


22.9 (11.5) 




20. 5 (14./) 






76.9 (S.5) 


77.8 (14.1) 


23.0 (8.5) 


22.2 (14.1) 


43.5 (10.7) 


56.5 (19.2) 


9.4 (3.9) 


38.4 (18.3) 


31.4 (10.5) 


16.5 (16.3) 


40.7 (10.6) 


34.9 (19.3) 


0.66 (0.82) 


1.4 (1.6) 


2.07 (1 .89) 
2.73 (2.17) 


0.16 (0.43) 
1.6 (1 .6) 





(N= £L 


0.00 (0.00) 


0. 


25 (0.40) 


0. 


50 (0.60) 


0 


52 (0'.66) 


0 


17 (0.42) 


0 


10 (0.25) 



0.05 (0.13) 



32.3 (12. I N 



HALF RESOURCE 
RESOURCE/ 
SPECIAL 
(N-6) 



0.00 (0.00 ) 
0.36 (0.44) 



0.18 (0.21) 



0.29 (0.59) 



0.00 (0.00) 



MOSTLY 

SPECIAL 

(N-16) 



i—i 1 1 1 1 1 1 1 1 1 1 RgwawnsT 

0.00 (0.00) 



. 0.03 (0.13) 



0.15 (0.54) 



0.01 (0.05) 



0.02 (0.07) 



OVERALL 
(N-^3) 



0.22 (0.41) 



0.19 (0.30) 



2 3.7 (9.5) 



28.0 (9.0) _ 
42.0 (17.8) 



6/ 1 (2.8) 



33.4 (17.3) 



39.6 (17.3) 



0.7 (0.67) 
1 .6 (0.82) 
2.35 (I .12) 



24.4 (11.5) 



24.2 (12.3) 



74.2 (12.5) 



0.03 (0.09) 



0.22 (0.38) 



33.7 (11.0) 



25.8 (12.5) 



41.4 (21.3) 



24.4 (11.8) 



15.4 (17.8) 



39.8 (21 . 1 ) 



72.7 (I I .3) 



27.3 (11.3) 



40.9 (12.1) 



26.3 (9.5) 



12.6 (9.6) 
38.9 (11.9) 



.39 (0.36) 



1.51 (1.59) 



1.24 (1.28) n.46 (0.83) 



1 .62 (1 .48) 



1.97 (1.49) 



0 


.04 (0.11) 


0 


.22 (0.52) 


0.29 (0.47) 


0 


.12 (0.26) 


0 


.09 (0.23) 


0 


11 (0.25) 


0 


21 .(0.28) 




34 


2 (10.7) 


24 


8 (9.6) 




73. 


1 (9.8) 


26. 


9 (9.8) 


41 . 


0 (11.7) 


18. 


3 (9.4) 


20. 


5 (11.1) 


38. 


8 (11.5) 


1. 


02 (1.15) 


1. 


10 (1.36) 


2. 


12 (1 .59) 
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feedback (AF) and questions (AQ) occurred in the special settings, especially 
the MR-S. Slightly more planned explanations (XP) and structuring/directing 
(SD) occurred in the regular class settings. 

In summary, the predominate instructor behavior (from the point of 
view of TS) was non-direct instruction (60%), and when direct instruction 
was provided, it was most likely to be academic feedback (14%), questioning 
(10%), or structuring/directing (7%). 

Instructor focus . The focus of the instructor move was coded along 
with the move itself. Of course, if the move was null, so was the focus.* 
On the whole, about 19% of the moves were focused specifically to the TS 
(TSFOCUS) and 22% to the group or another student in "the yroup which included 
TS (GRFOCUS) . When comparing delivery systems, regular class teachers (FR, 
MR-G,<HR-G) are more yroup-f ocused , and special teachers (MR-S, HR-S, and 
MS) are more TS-focused in their direct instruction. Two and one-half to 
three times as many direct academic instructor contacts with the TS 
occurred in the smaller special settings as did in the larger regular 
settings. This appears to be directly correlated with the class size, as 
would be expected: the fewer the students, the more time a teacher can 
spend with each individually, all other things equal. Clearly, much more 
individual academic instruction occurrs in the resource and self-contained 
classrooms, and the instruction tends to be more individualized (as discussed 
above — NSTUDSAM, Table 3). 

Regular class teachers did appear to spend more time indiv.idua.lly 
with the TS than would be expected. Given that 23 to 2b or more students 



••'The reason NULL focus is 5 { )Z overall is due to occasional error:; in 
data transmission over phono lines that were not detected and corrected by 
the computer (les.s than .001 of .25 million data items transmitted). 
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fe present in the regular elementary class, a teacher who gave equal time 
to each student would be expected to spend about 4 to 5% of the time 
individually with each student. Using that figure as a basis for comparison, 
FR and MR-G teachers are spending about twice as much time with the TS. 
The HR-G teachers appear to be, mostly group-oriented, where TS's are typically 
mainstreamed in social studies, science and math activities. 

Joint behaviors (TS engagement x move x focus) . On pps. 2 and 3 of 
Table 4, it can be seen generally that TS engagement rates during direct 
instruction are very high compared to non-engagement during direct 
instruction. More will be said about this relationship below. In 
particular, 2 to 4 times as much AF and AO specifically, focused to TS 
occurred in the special settings (MR-S, HR-S, MS). For group-focused direct 
instruction, regular class teachers were 2 to 3 tfimes more likely to provide 
planned explanations and structuring/directing /than special teachers. 

Looking at variables 47 and 48, TS engagement during non-direct 
instruction (ENNUNU) over all delivery systems was 34%, compared to non- 
engagement during non-direct instruction ^NUNU) , which occurred 25% of the 
time. Another way of interpreting this is that TS is only a little more 
likely to be on-task than off-task during non-direct instruction (i.e., 
seatwork). Given that non-direct instruction occurred about 60% of the time, 
this finding seems highly significant from the point of view of educational 
programming for mildly handicapped students. 

Composite behavi ors . Over all delivery sys' -ms, TS's tend to he; 
engaged (EN) about 73% and non-engaged (NE) 27% of the time. Given that 
25% of the NE occurred during seatwork (non-direct instruction), it is clear 
where the large majority of NE occurred. There appears to be little 
difference in E.N and NE across the deliverv systems, with the exception 
of the MR-S, where EN was somewhat greater (78% vs. 73% on the whole). 
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Direct Instruction (DI— either to TS or the group) occurred about 
41% of the time on the whole. FR teachers engaged in less DI (35%) and 
MR-S teachers in more DI (57%), compared to the other delivery systems. " 
Perhaps most noteworthy of all, TS engagement during direct instruction 
(ENDI) occurred 39% of the time, whereas non-engagement during direct 
instruction (NEDI) occurred about 2% of the time. In other words, TS is 
about 19 times as likely to be on-task during DI than off-task. Recall that 
TS was only slightly more likely to be on-task than off-task during non- 
direct instruction. It is little wonder that more DI has been found in 
past research to result in higher student achievement, since EN is a 
necessary (though not sufficient) condition for learning to occur. These 
findings suggest that one way to increase students' task emuieument is to 
directly teach them more often. 
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Results: Table 5 

In Table 5, Instructor and TS behavior in reading/math activities in 
the three class types (not delivery systems) is summarized. Note that some 
units of analysis are included in more than one class type (i.e., total N=43, 
but 63 units are analyzed— e.g. some of the same TS's were used in computing 
resource room means as well as regular class means) . These results generally 
follow the same pattern as did those in Table 4; thus only marked differences 
will be discussed. 

Variables 17 and 18, TSFOCUS and CRFOCUS, show the differences in focus 
in the regular, resource, and special classes. TSFOCUS o n U rred 35% of the 
time in the special class, 26% in the resource room and 10% in the regular 
class. GRFOCUS showed the opposite trend: Regular was 29%, resource was 
21%, and special was 8; 5%. In other words, special class teachers tend to 
work individually with TS's 4 times as often as with groups, resource 
teachers about half individualized and half grouped, and regular teachers 
tend to work with groups about 3 times as often as they do specifically 
with the TS. 

Variable 51, DI (direct instruction), was highest in resource rooms 
and lowest in regular classrooms. The same ratio between END I and NED I 
(about 19 to 1) generally obtains across the three class types. 
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TABLE 5 



Teacher and Target Student Behavior by Class Type 
Reading and Math Activities Only (16*»3 activities observed) 

[Mean Percent Time (Standard Deviation)]" 



VARIABLE 


REGULAR 
CLASS 


RESOURCE 
ClASS 1 
(N=20) 


SPECIAL 
(N-16) 


1. EW 


26.8 (9.3) 


22.7 (11.5) 


25.7 (10.2) 


2. EO 


7.6 (A. A) 


20.2 (11.0) 


19.1 (10. 1) 


3. EC 


31. 4 (10.0) 


27.4 (10.2) 


21.1 (7.0) 


ED 


7.1 (2.1) 


1 5.3 (3.1) 


7.3 (2.9) 


5. MI 


4.1 (1.9) 


I 4.6 (3.3) 


5.2 (2.6) 


6. NW 


4 . 5 (3.6) 


6.6 (5.2) 


6.7 (4.4) 


7. NO 


18.4 (10.0) 


1 13.2 (12.7) 


14.9 (9.8) 






! 




8- N'U J 60.8 (12.6) 


52.6 (21.2) 


56.7 (18.6) 


9. AM I 0.8 (1.2) i 


2.4 (4.8) 


2.7 (1.9) 


10. AF 1 12.3 (4.7) 


20.6 (11.9) 


15.4 (7.9) 


11. AO 


9.2 (4.8) 


12.9 (9.5) 


10.4 (8.9) ! 


1?. XN 


4.0 (2.2) I 


3.1 (2.2) 


3.5 (2.7) | 


13. XP 


4.4 (3.5) I 


— 

2.2 (2.5) 


1.5 (3.1) j 


I 1 '- SD 


7.2 (2.1) | 


5.0 (2.8) 


7.2 (3.2) 1 


15- TF 


1.4 (1.1) j 


1.2 (1.8) 


2.6 (1.9) 










16. NUFOCFS | 


60.8 (12.6) 


52.6 (21.2) 


56.7 (18. 7) 


17. TS FOCI'S 


10.3 (4.7) 


26.1 (17.0) 


34.8 (18.0) 


18. CRFOCUS 1 


28.9 (13.4) 


21.3 (18.8) 


8.5 (8.3) 




— . ■ 






















1 \ 







-Unit of Analysis = Target S tudcnn—Note : Them is some 
overlap of same TS in different class types. 
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TABLE 5 (cont'd) 
[Mean Percent Time (Standard Deviation)] 



VARIABLE 


REGULAR ♦ 
CLASS 
(N=27) 


RESOURCE 
• CLASS 
(N=20) 


SPEC IAL 
CLASS 
(N=16) 


19. ENAMTS 


0.3 (0.4) 


1.6 (2.6) 


2.4 (1.8) 


20. ENAFTS 


4.1 (2.6) 


12.3 (9.5) 


13.5 (6.51 


2 1 . ENAOTS 


2.4 (1.7) 


j 7.0 (6.3) 


8.3 (9.01 


22. ENXNTS ■ 


1.2 (0.91 


1 1.8 (1.91 


3.2 (2.6) 


23. ENXPTS 


0.1 (0.31 


0.2 (0.6) 


0.2 (0.31 


2k. ENSDTS 


1.1 (0.9) 


2.0 (2.3) 


4.3 (3.21 


25. ENTFTS 


0.3 (0.3) 


0.4 (0.9) 


1.2 (1.2) ' j 




i 




26. XEAMTS 1 0.01 (0.06)! 0.03 (0.1 SI 


0. 14 (0.581 1 


27. NEAFTS 


0.09 (0.26) 1 0.?8 en. 77^ 


r 

0.16 (0.391 ' 


28. NEAOTS 


0.02 (0.06) ! 


0.03 (0.151 


0.03 (0.111 


29. NEXNTS 


o.oo (o.on j 


0.00 (0.001 


0.00 (0.021 


30. NEXPTS 


0.00 (0.00) 1 


0.01 (0.071 


0.00 (0.001 


31. NESDTS 


0.03 (0.09) 1 


0.03 (0.14) 


0.09 (0.34) 


32. NETFTS 


0.58 (0.62) 


0.39 (0.70) 


1.18 (1.40) 










33. ENAMGR 


0.42 (0.87) 


0.80 (2.44) 


0.13 (0.29) 


Ik. ENAFGR I 


7.85 (4.67) 


7.89 (9.47) 


1.65 (2.83) 


35. ENAOGR 


6.27 (4.21) 


5.70 (6.31) 


2.03 (2.88) 


36. ENXNCR 


2.51 (2.06) 


1.21 (1.97) 


0.34 (0.54) 


37. ENXPGR I 


4.10 (3.34) 


1.94 (2.581 


1.31 (2.94) 


38. ENSDOR 


5.91 (2.20) 


2.95 (2.43) 


■ 

2.76 (1.91) 


139. ENTFOR 1 


0.29 (0.37) j 


0.06 (0.17) 


0.15 (0.36) 






1 
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TABLE 5 (cont'd) 
[Mean Percent Time (Standard Deviation)] 



VARIABLE 


REGULAR 
CLASS 
. (N=27) 


RESOURCE 
CLASS 
(N*20) 


SPECIAL 
CLASS 
(N=16) 


^0. NEAMGR 


0.07 (0.16) 


0.00 (0.00) 


0.00 (0.00) 


4 1 . ENAFGR 


0.27 (0.53) 


0.13 (0.30) 


0.00 (0.00) 


hi. NEAOGR 


0.48 (0.57) 


\ 0.16 (0.49) 


0.01 (0.04) 


^3. NEXNGR 


0.22 -(0.42) 


I 0.09 (0.33) 


0.01 (0.05) 


44. NEXPGR 


0.18 (0.37) 


\ 0.01 (0.06) 


0.00 (0.00) 


k 5. NESDGR 


0.14 (0.29) 1 0.08 (0.24) 


0.02 (0.06) 


*»6. NETFGR 


0.20 (0.22) 


| 0.27 (0.61) 


0.09 (0.17) 










47. ENNUNU 


36.0 (12.3) | 29.6 (15.4) 


31.6 (14.2) 


h 8. MENUNU 


24.7 (9.4) | 22.9 (15.5) 


25.1 (11.8) 








4<). EN 


73.0 (9.7) 


75.5 (15.0) 


73.2 (12.0) 


50. NE 


27.0 (9.7) i 


24.5 (15.0) 


26.8 (12. 0)"! 


51. DI 


39.2 (12.6) | 


47.4 (21.2) 


43.3 (25.7) J 


52. ENDITS 


9.5 (4.6) 


25.3 (5.9) 


33.1 (17.9) 1 


53. ENDIGR .| 


27.4 (12.7) 


20.5 (18.6) 


8.4 (8.3) j 


5^. END I ' 


36.9 (12.1) 


45.9 (21.0) 


41.5 (18.8) 1 


55. NEDITS J 


0.74 (0.73) 


0.78 (1.18) 


1.61 (1.79)1 


56. NEDIGR 1 


1.56 (1.51^1 0.75 (1.13) 


0.13 (0.21)( 


57. NEDT 1 


2.30 (1.76) 


1.54 (1.46) 


1.73 (1.77) 














■ r _ 
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Results; u Table 6 

In Table 6, instructor and TS behaviors are grouped by task success in 
reading/math. Note that the analysis was performed two ways: 1) Using 
the educational activity as the unit of analysis and 2) Using the TS as the 
unit of analysis. 

TS behavior . TS's are engaged covert (EC) more in high success than 
in low success activities. Much more off-task (NO) occurs during low 
success activities than in high success activities. Whether TS's perform 
poorly because they are off-task, or they are off-task because they perform 
poorly, cannot be determined from these descriptive results. The results do 
tend to confirm the hypothesis that TS engagement is necessary but not 
sufficient for high task success. Clearly, other factors affect task 
success in addition to engagement, such as appropriateness of curriculum 
to student ability level. 

Instru ctor behavior . There appears to be -more non-direct instruction 
(NU) in low success than in medium or high success activities. Less 
academic feedback (AF) and less planned explanation (XT) ate provided 
during low success tasks. Also, when teachers give less direction (SD), 
task success is more likely to be low. 

Focus of move . In low success activities group focus is less than in 
medium and high success activities. What these results mean will become 
clearer when combinations of behaviors are examined. 

Joint behaviors (TS move x instructor move x fo cusK No clear trends 
are evident in variables 19 through 32, except, that more NET ITS occurred in 
low task success activities (i.e., instructor disciplining of TS off-task 
behavior). The trends appear to be clearer in the group focus variables 
(33 through 46). When more instructor AF, XP, and SD directed to the group 
was provided, TS's were 2 to 3 times more likely to perform very well than 
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TABLE 6 \ 

Target Student and Teacher ALTOS Behaviors by Task Success: Reading and Math On.y 

Mean Percent Time (Standard Deviation) 





" 

HIGH SUCCESS 

APT 1 \7 1 T 1 FQ 

(M-601) 


| MEDIUM 
1 SUCCESS 

APT 1 If 1 r i rr 

ACTIVITIES 

Cm =7 20 ) 


LOW SUCCESS 
ACTIVITIES 

(N=1'f/) 


1 . • l-W 


30.2 (31. n * 


29.4 (27.7) 


26.2 (22.9) 


2. F.O 


13.8 (22.0) 


15.8 (22.7) 


12.3 (18.5) 


_3. EC j 


29.9 (27.6) 


28.0 (24.6) 


22. 3 (19.7) 


I'D 


7.8 (10.9) 


6.5 (9.5) 


5.7 (9.2) 


5. NI 


4.0 (8.3) 


3.8 (7.5) 


4.3 (6.1) 


6. NW 


4.8 (9.8) 


4.1 (8.9) 


5.4 (10.0) 


7. t:n 


9.5 (14.9) 


12.5 (17.2) 


24.0 (26.0) 










8. nu 


54.9 (38.1) 


57.3 (36.8) 


63.7 (33.6) j 



9. AM 



hi C6.5) i 2.9 (9.7) 



10. 



2.4 (6.8) 



11. AO 



\1L 



A.. 



IhUlhlLl ^5.1 (22.3) 11.8 (18.5) 14t6 (7t8) " 



10. 9 (19.5) 



2.7 (6.3) 



10.8 (19.0 ) 
2.3 (5.6) 



13. XP 



Ut. SI) 



15. TF 



16. ;;c Focrs 



17. TSroocs 



7.7 (10.7) 


1 6.4 (9.6) 


! 1.6 (4.6) 


! 2.0 (5.4) 






! 54.9 (38.1) 


57.3 (36.8) 


j 20.0 (27.8) 


22.6 (28.3) 1 



9.8 (18.1) 
3.8 (8.8) 



3.1 (10.3) 0.7 (2.9) 



m'GH SUCCESS 


MEDIUM 
SUCCESS 
(N =/, 3) 


LOW 
SUCCESS 
(N=39) 


96 1 ( 1 /. T\4.s 


j 26.0 (10.8) 


26.3 (17.1) 


19 Q / Q /. \ 


14.7 (11.3) 


12.5 (15.6) 


JUt4 Uj.D/ 


' 26.6 (11.1) 


23.1 (15.fi) 


7 1 ( 1 /. \ 

/ # J 


7.6 (4.2) 1 S.fi n 


^ . J \J,H) 


4.7 (2.3) 


4.8 (4.6) 


6.0 (4,9) 


6.1 (5.0) 


5.3 (7.3) 


12,8 (7.9) 


14.3 (10.8) 


22.2 (15.3) j 








57.0 (17.9) 


56.1 (15.1) 


61.6 (26.5) 1 



1-0 d.7) 2.0 (2.4) 



1.9 (2.9) 



15.7 (8.4) 



10-7 (8.2) 10.2 (7.2) 



5.3 (8.1) 



2.5 (4.9) 



63.6 (33.7) 



21.5 (25.6) 



I^RTOa^ | 25 . 1 (33.9) j 20.1 (30.6) 15.0 (25.2) 



,'r D 9 r vity is Unit of Analysis 
"tKJLi-jt Student is Unit of Analysis 



4.1 (3.9) 3.5 (3.4) 



(4.0) 3.4 (4.8) 



7.3 (3.5) 7.6 (4.1) 



12.5 (17.3) 



.10.6 (12.3) 



4.7 (5.6) 



0.8 (2.6) 



5.5 (5.0) 



'• 8 0-8) 1 1.6 (2.1) J^5nj)) 



57.1 (17.9) 56.2 (15.1) 



13.7 (15.8) ; 22.3 (14.2) 



19.9 (11.7) 21.5 (12.9) 



61.6 (26.5) 



24.6 (23.0) 



13.7 (18.4) 



I 
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TABLE 6 (cont'd) 
Mean Percent Time (Standard Deviation) 



VARIABLE 


II 1 All mm, a • A mm M tm 

HIGH SUCCESS 
ACTIVITIES 
(N=601) 


1 MEDIUM 
1 SUCCESS 
1 ACTIVITIES 

(N=720) 


LOW SUCCESS 
ACT 1 V 1 T 1 PC 

1 1 V 1 1 1 CO 

(N=42) 


n 1 bn bUCC ESS 
(M»2) 


MEDIUM 

SUCCESS 

(N=*»3) 


LOW 
SUCCESS 
(N=39) 


19. ENAMTS 


0.8 (5.5) 


1.9 (8 J)) 


i.9 (6.00) 


0.7 (1.5) 


1.4 (1.8) 


1.5 ( ? ?) 


20. I-NAFTS 


9.5 (18.2) 


1 9.5 (16.8) 


7.6 (15.1) 


8.1 (4.7) 


9.2 (6.5) 


9 J 1 (16 Q) 


21 . ENACTS 


5.0 (13.7) 


5.3 (13.1) 


5.2 (10.6) 


5.3 (5.9) 


5.0 (5.6) 


5.7 (7.1) 


22. E NX NTS 


1.2 (A. 2) 


1 1.4 (4.2) 


2.2 (5.5) 


1.7 (2.7) 


2.3 (3.3) 


3.2 (4. 3) 


23. EMXPTS 


0.1 (1.1) 


1 0.3 (2.6) 


0.2 (1.1) 


0.1 (0.4) 


0.2 (0.5) 


0.2 (0.6) 


2k. ENSDTS 


2.0 (5.2) 


2.1 (5.9) 


1.9 (4.8) 


1.9 (2.1) 


2.0 (2.3) 


2.5 (4.2) 


25. EMT1-TS 


0.7 (2.7) 


0.8 (3.9) 


0.5 (1.9) 


0.9 (1.1) 


0.6 (1.5) 


0.6 (1.2) 
















26. NEAMTS 


0.02 (0.58) 


0.01 (0.22) 


0.00 (0.00) 


0.01 (0.09) 


0.00 (0.01) 


o.oo (o.on) 


27. NKAKTS 


0.20 (1.85) 1 


I 0.29 (1.63) 


0.29 (1.71) 


0.11 (0.40) 


0.15 (0.43) 


\j * \j \j \\j % \j\t j ] 

0.45 (2.02) 


28. uEAOTS 


0.04 (0.82) 


0.03 (0.46) 


0.02 (0.21) 


0.03 (0.14) 


0.03 (0.14) 


0.01 (0.07) 1 


29. NF.XN'TS 


0.00 (0.00) 


0.01 (0.17) 


0.00 (0.00) 


0.00 (0.00) 1 


0.00 (0.02) 


_ W • V 1. \\J % \i § J ■ 

0.00 (0.00) I 


30. I.'KXPTS 


0.00 (0.00) 


0.01 (0.21) 


0.00 (0.00) 


0.00 (0.00) 


0.00 (0.02) 


0.00 (0.00) I 


31. NESDTS 


0.04 (0.64) 


0.06 (0.94) 


0.00 (0.00) 


0.03 (0.11) J 


0.06 (0.39) 


0.00 (0.00) 1 


32. NKTFTS 


0.41 (2.3) 1 


0.80 (3.12) 


1.49 (3.72) 


0.46 (0.74) J 


0.57 (0.92) 


1.45 (2.94) 
















33. ENAMCR 


0.42 (3.3) 1 


0.95 (5.1) 


0.42 (2.3) 


0.22 (0.61) 


0.54 (1.10) 


0.32 (1.16) 


3'i. C'AFGR 


7.00 (15.41)1 


5.13 (13.5) 


3.40 (8.5) 


6.25 (6.34) 


6.00 (5.96) 


2.54 (4.60) 


35. KVu^C.R 


5.73 (13.8) 


5.19 (13.6) 


4.39 (13.4) 


5.23 (5.01) 


4.89 (4.72) 


4.50 (8.75) 


36. ENXUGR 


1.37 (4.3) 


0.95 (3.8) 


1.32 (6.1) 1 


2.13 (3.04) 


1.24 (1.82) 


1.36 (4.42) 


37. KXXPGR 

! 


3.96 (12.8) 1 


2.69 (9.9) 


0.46 (2.4) 


3.21 (3.73) 


3.18 (4.69) 


0.63 (2.18) 1 


38. EN'SDGR ! 


5 ; 2 s (in n) I 


4.07 (8.0) 


3.28 (6.4) 


5.31 (3.47) 1 


5.36 (i.22) 


2.85 (3.89) 


39. v:<\yvak 


0.27 (1.7) | 


0.16 (1.2) 


0.28 (1.9) 


0.34 (0.83) 


0.12 (0.26) 


0.20 (0.87) J 


1 

9 ' 
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TABLE 6 (cont'd) 
Mean Percent Time (Standard 



Deviat ion) 





W A B I A R 1 C 


HIGH SUCCESS 
ACTIVITIES 
f N = 6 0 1 ) 


mp n 1 1 iM 

SUCCESS 
ACTIVITIES 


LOW SUCCESS 
ACTIVITIES 

\ IN — n L ) 


HIGH SUCCESS 


MEDIUM 
SUCCESS 


LOW 
SUCCESS 
(N=39) 




U.U/ CU.ooJ 


0.08 (0.96) 


0.09 (0.68) 


0.05 (0.19) 


0.04 (0.14) 


.0.04 (0.26) 


k 1 . a vrii 


n i 9 m 'in 


0.20 (1.96) 


0.24 (1.52) 


0.17 (0.61) 


0.26 (0.77) 


0.33 (1.41) 


/i 2 . mi? \ nri) 
T *■ • r.Ayt »k 




0.26 (2.10) 


0.40 (2.03) 


0.20 (0.49) 


0.25 (0.59) 


0.39 (1.02) 




n 11 f 1 io ^ 


0.01 (0.27) 


.. 0.27 (1.89) 


0.18 (0.44) 


0.01 (0.07) 


0.15 (0.62) 


4^4. Mrvprii 

^ ^ • IN LA t 


n n7 fn ftft^ 


U.09 CI • 4o) 


0.02 (0.24) 


0.07 (0.23) 


0.07 (0.30) 


0.01 (0.10) 


'} 5 . n rcnrD 


n nft fn ftA ^ 


n 1c / 1 1 1 \ 

0.15 (1.13) 


0.20 (1.32) 


0.13 (0.44) 


0.13 (0.51) 


0.21 (0.78) 


w • Itl. 1 I 


W i 1 O \ l • <LO ) 


1 n 17 / 1 1 ~i\ 
0. 1 / CI .47) 


0.18 (1.45) 


0,18 (0.37) 


0.25 (1.09) 


0.21 (0.76) 


















ift n fis s} 


1Q 1 /II C\ 


33.1 (29.0) 


35.4 (14.5) 


32.9 (13.3) 


— . 

32.5 (2l\2) 


'l8. V|. ,4, |! ,, l» 
1 1 1 .t 1 1 i • I 




lo.Z C 10 . / ) 


30.4 (25.0) , 


21.7 (8.9) 


23.2 (9.8) 


29.1 (15.3) 
















'«9. r.:: 


81.7 (19.0) 


76.6 (19. 2) 


A ^ A ^9 9 v 1 


lh . 7 (9.1) 


\ 74.9 (9.9) 


67./ (15.5) 


50. ;;k 


13.3 (19.0) 


20. A (19. 2j 


^1 ^ ^ 9 $ r > ^ ' 


99 9 ( a a \ 
. j C " • 1 ) 


Of* 1 / r\ r\ \ 

25 . 1 (9.9) 


00 i /ir c\ 

32.3 (15.5) 


51. ni 


. 1 (38.1) 


42.7 (36. 8j 


1 f\ 1 /11 /;^ 


4 j . 0 (17.9) 


4j.9 (15.1) 


38.4 (26.5) 


52. i::;i)[ts 


19.3 (27.5) 


21.3 (27.9} 


1 v • 0 ^ Z»l • •» ) 


10/* /II / \ 

1 0 . f ) ( 11 . 4 ) 


20.7 (12.8) 


OO H / 0 O /• \ 

22.7 (22.6) 


53- k:;i)k;r 


9/, i /9i 


10 9 (90 /.^ 


i y . .) C - J • 1 ) j 


21.7 (14.9) 


21.3 (13.8) 


12.4 (16.9) 


5 V. f.;;:i> j 


A 7 ^ ( 17 ft ^ 






41.3 (17.4) 


42.0 (15.4) 


35.1 (24.9) 


55- :;i;niTS 


n 71 f*\ 9^ 


1 21 (3 72^ 


1 . oU C4 • 00 ) 


0. 64 (1 . 03) 


0.82 (1.22) 


1.90 (3.50) 


56. tji-nrnt 


W 1 O 1 \ • O 7 / 


0 Q7 (A fi*M 


1 / 1 / / noN 
1.41 C'» . v 3) 


0.97 (1.57) 


1.02 (1.89) 


1.35 (2.91) 


57. r;r:i>r 



1.53 (5. 17) 


2. 18 (5. 7 f )) 


'} 99 ^ ft 9 A ' 


l.o*i C 1 • " i) 


1.84 (2.18) 


3.25 (4.20) 










_ 
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very poorly. It would appear that when group-directed AF, XP, and SD is 
absent or slight within an activity, TS's are more likely to do very poorly 
on the reading/math task. One interpretation of these results is that 
when teachers give some explanation (e.g., modeling, demonstrating), 
directions, and feedback to the group , then TS's are more likely to do 
very well on the activity than they are to do very poorly. This makes 
sense, since the majority of TS's have reading difficulties, so they would 
be less likely to understand writte n directions and explanations~i . e. , 
they are likely to perform poorly if they do not understand what they are 
to do and/or how to do it. In addition, they have the opportunity to self- 
correct their errors and confirm their correct work by listening to 
academic feedback given to other students. One might also speculate that 
TS's perform better when they have the opportunity to view peer modeling 
of correct task performance, which is more apt to occur during group-focused 
instructor moves. This is consonant with higher EC during high success 
tasks. 

Combined behaviors . When non-engagement (NE) is higher, TS is more 
likely to perform poorly on the task. When TS is engaged during direct 
instruction to the group (ENDICR) , s/he is about twice as likely to perform 
very well than very poorly (2J% vs. 12%). Also, the reverse trend obtains 
for NEDI: TS is about twice as likely to perform very poorly than very 
well then not-engaged during direct instruction (3.2% vs. 1.6%). 



103 



90 



Results: Table 7 , 

1 

In Table 7 estimates of average probabilities of TS and instructor 
relationships are summarized. These probabilities were obtained from the 
mean percent times given' in Table 4. For example, the mean percent time 
TS was engaged during direct instruction (overall) was 38.8 and the mean 
percent DI was 41.0. Therefore the estimated probability of EN given 
that Dl was occurring is 38.8/41 .0=. 95. More formally, P(EN|DI)=.95, or 
the chances are that 95 times out of 100 TS will be engaged during direct 
instruction, whereas about 5 times out of 100 s/he will be non-engaged 
(P(~EN|DI) = .05) . 

What is noteworthy is that this relationship between EN and ~EN during 
direct instruction is fairly constant across all delivery systems. 

TS engagement during non-direct instruction is much less (P(EN| ~DI)=. 58) , 
and for non-engagement, P(-EN| ~DI)=.42. While TS is lh times more likely 
to be engaged than non-engaged during non-direct instruction, this is much 
less than the fact that s/he is about 19 times as likely to be engaged 
as not during direct instruction. Another way of interpreting this is that 
TS is about 12 times more likely to be off-task during non-direct instruction 
than during direct instruction. Note that when non-engagement is higher, 
students are more likely to perform poorly on reading/math tasks (see 
Table 6) . 

In summary, type of delivery system is irrelevant to the relationship 
between student engagement and instruction. When DI occurs, students arc 
extremely likely to be on-task; when DI is absent students a're only n lightly 
more likely to be on-task than off-task. 
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TABLE 7 



Probabilities of Relations Among Student Engagement (EN), 
Non-Engagement (-EN) , Direct Instruction (Ul) and Non-Direct Instruction (-DI): 

[Average Probability of Relationship] ' , 



RELATION 
y (i::: I pi) 



( -en|di) 
^' (~i::!l-i)T) 



P(KN) 

p(-f.:0 

P(i)i) 

p(-i)f) 



FULL-TIME 
REGULAR 

.94 



.06 
.42 



...71 
.29 
.35 
.65 



MOSTLY 

REGULAR 

REGULAR 

.94 



.06 
.64 
.36 



j_77_ 
.23 
.44 
.56 



MOSTLY 
REGULAR 
RESOURCE 

I " 1 IB ■ ' rrrr~m ttt: _j_ egg: 

.97 



HALF RESOURCE 
REGULAR 

.94 



.03. 
.53 
.47 



.78 
.22 
.56 
.44 



■ 06 
.61 
.39 



.72 

.28 
.42 
.58 



HALF RESOURCE 
RESOURCE/ 
SPECIAL 

ggggctoa gcraoi t: a nam 

.96 



MOSTLY 
■SPECIAL 



.04 
..59 
.41- 



.74 

.26 
.41 
.59 



r™™^,™^!' OVERALL , 

gnMaigaa i ' agaapgatc }|j«zexc«:rsia* causer- ] 

•95 # ! 05 



.05 
.60 
.40 



.73 
.27 
.41 
.59 



.05 
.58 
.42 



.73 
.27 
.41 
.59 



Q 
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Results: Table 8 

In Table 8, the relations among task success, instructor behavior and 
student engagement are explored. These are given over all delivery systems. 
First, it was found that total ,DI by itself does not substantially alter 
the probabilities of task success. (P(Hi)=.41, P(Med)=.49, P(Lo) = . 10)— see 

ri 

lower right section of Table 8. However, when investigating those specific 
DI variables that did seem to make a difference (see Table 7), some relevance 
to task success was found. While academic feedback to TS (AFTS) by itself 
was irrelevant to task success, AFGR, SDGR and XPGR did appear relevant. 
Given the base rate of low task success (P(Lo)=.10), it is reduced when 
group feedback (P(Lo| AFGR)=.04) , explanations, (P(Lo|XPCR)=.02) , or directions 
(P(Lo |SDGR=.06) are present. This is simply another way of stating what was 
concluded from Table 7 — i.e., the chances of low task success are decreased 
when more group feedback, explanations and directions are provided. When 
they are provided, chances of high task success are only slightly higher than 
the base rate. These results suggest that. these specific kinds of DI are 
positively relevant to task success, but in themselves are not sufficient. 
That is, other factors, such as the match between student skill level and 
curriculum 4 content and student motivation and feelings, may also be important. 
Unfortunately, these other factors were not measured in the present study. 
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TABLE 8 

Probabilities of Relations Among Student Task Success 
(Hi, Med, Lo), Instructor Behavior, and Student Engagement 



RELATION 


OVER ALL 
DELIVERY 
SYSTEMS 


j RELATION 


r\\ic d aii 
UVtR ALL 

DELIVERY 
SYSTEMS 


P (Hi | AFTS) 


.38 


(J P(Hi EN) 


.42 


P(Med AFTS) 


.51 


! P(Med | EN) 


.49 


. P(Lo 


AFTS) 


.11 


J 


P(LolEN) 


.09 






i 






P(Hi 


AFGR) 


.44 


i 


P(Hi|-EN) 


.38 


P(Med AFGR) 


.51 


— j 


i P(Mcd|-EN) 


.49 


P(Lo AFGR) 


.OA 


tj .P(Lo|-EN) 


.13 




i 
( 


1 


1 

i 


P(Hi 


SDGR) 


.42 


f 

r 


P(Hi|DI) 


.41 j 


P (Med 1 SDGR) 


.52 


k 


P(McdlDI) 


.50 j 


P(Lu 


SDGR) 


.06 


% 


P(Lo DI) 


.09 j 




t< 






P(Hi XPGR) 


.45 


i 


?(m -di) 


.41 


P(Med XPGR) 


.53 




P(Med |-DI) 


■ 

.48 


P(Lo XPGR) 




P(Lo -DI) 


, i 1 1 


* 


rt 






P(Hi) 


.« 1 




1 


P(Med) 


.49 1 






P(Lo) 




.10 1 








t 








* - 

i 








i 






I 


» 

f 
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Results: Tabl e 9 



m Table , probabIllty estlmates are presented 

instructor moves are specificallv hmi, ^ 

a . „ br ° ken d0Wn lnt0 SDIGR (=AFGR+XPGR+SDGR) 

and non-direct instruction H>I). Here if M k 

Here it can be seen the chances of low 
«-~ - s ucceS5 are less durlng ENSDIGR(,05) than in the ^ ^ 
<•» «- •">• -at ls . ^ handlcapped ^^^^ ^ ^ ^ co 

^ "Ke ly to perform very po „ ly ^ a reading/math ^ 

d Irect group Instructl0 „ which inciuies academic • 
Planned explanations and structuring/directing. 
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TABLE 9 

Probabilities of Relations Among Student 
Task Success (Hi, Med, Lo) Hiven Student Engagement 
(EN, -EN) and Specific Instruction 
(SDIGR = AFGR + XPGR + SDGR, -DI) 





HIGH 

•SUCCESS 


- MEDIUM 
SUCCESS 


LOW 
SUCCESS 


EN'. SDIfiR 


.44 


.52 


.OS 


EN.-DI 


.43 


.47 


.10 


-EN.SDICR 


.35 


.51 


.14 




■ 38 1 


.49 


. 13 
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How r i:ni- Is Spt?nc by Mildly Handicapped Elementary Students 

Tablu 10 shows the amount of time, expressed in minutes per day on 
the average and in percent time., that mildly handicapped students spend 
in various activities during the school day. These data were aggregated 



observations (Year 2 and 3 observations were one to two hours per day in 
math and reading activities only). For purposes of comparison, BTES data 
on normal students using the same observation categories were taken from 
the Fisher, et al. (1978) report. Note that composite averages and 
percentages were computed across both grades 2 and 5 for the BTES 
results, weighted by respective sample sizes in those grades, so that 
comparisons could be made with our sample of mildly handicapped students 
(grades 1 through 5). 

From Table 10 it can be seen that there are many similarities in the 
profiles of mildy handicapped and normal children in elementary schools. 
One notable differeence was the length of the school day in our sample 
(368 minutes per day) compared to that in the California schools (333 
minutes per day). Thus, when making comparisons, percent time should be 
used. Normal students spend about 6 percent more time in reading and 
language arts than do mildly mentally handicapped (MMH) students. Math 
time is almost identical. MMH students spend 3 percent more time in 
transition, but percent time in other activities is almost identical to 
normal students. It would appear that although the MMH students were in 
school longer than their normal counterparts, the extra time can be 
attributed mostly to more time spent in non-academics, break, transition 
and management procedural. 

MMH student engagement time in minutes per day, as well as 
percentagewise, is almost identical to normal students. However, MMH 



from the Year 1 observations only, since those were full-day 
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Table 10. II()W TIME TS SPENT IN ELEMENTARY SCHOOLS: COMPARISON OF CITH & BTES RESULTS 





HANDICAPPED 


NORMAL 




(CITH) 


a 1 


(BTES)* 2 




(Grades 


1-5) 


(Grades 


2 + 5) 


ACTIVITY TYPE 


Min/Day Pet, Time 


Min/Day 


Pet .Time 


Reading and Language . Arts 


90 


24 


99 


30 


Math 


41 


11 


40 


12 


Other Academic 


24 


6 


13 


4 


Non-Academic 


64 


17 


57 


17 


Break 


89 


24 


1 1 


n «j 1 
CO 


Wait 


(*7) 


\ j 


4 


1 


Transition 


47 


13 


34 


10 


Management /Procedural 


13 


3 


8 


2 . 


Length of School Day 


368 




333 




ACTIVITIES WHICH INCT TIDF RFAHTNIrt /MATH 










AS PRIMARY OR SECONDARY CONTENT AREA 


138 


38 


138 


41 


- Student Engagement 


102 


75 


101 


73 


- Student Non-Engagement 


36 


25 


37 


27 


- Direct Instruction 


57 


42 


42 


30 


- Non-Direct Instruction 


82 


58 


96 


70 



TASK SUCCESS READING: 

-High 

-Medium 

-Low 

-Unknown 

TASK SUCCESS MATH: 

-High 
-Medium 
-Low 
-Unknown 

TASK SUCCESS ALL ACTIVITES: 

-High 

-Medium 

-Low 

-Unknown 



25 
43 
11 
10 



9 
20 
7 
5 



76 
75 
20 



36 
53 
10 



33 
48 
19 



46 
44 
10 



48 
48 
4 



17 
22 
1 



68* 
79* 
5* 



48 
48 
4 



42 
56 
2 



45* 
52* 
3* 



*Reading & Math Only 



9 

ERIC 



Results from full day observations of mildly handicapped students ,fr 0 m Year I 
of this study, using ALTOS: average minutes per day & percent time (grades 
1-5 combined) 

Results from full day observations of normal students BTES study (Fisher, et , 
al., 1978): average minutes per day & percent time (grades 2+5 combined) 
Wait only observed in Reading/Math Activities 
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students spend about 12 percent more time receiving direct instruction 
(42 percent vs. 30 percent). 

The largest differences occur when looking at task success (Table 
10), MMH students experience high task success in reading 12 percent 
less than do normal students. MMH students also experience low task 
success 6 percent more of the time than do normals. A similar pattern 
obtains for task success in math activities. Notably, MMH students 
experience low task success in math 17 percent more often. Given the. 
relationship between high task success and academic achievement (see 
following section), it is therefore not surprising that MMH students 
achieve at lower levels and at slower rates than do their normal 
counterparts. 

In Table 11, student and instructor behaviors in reading and math 
activities only in the two studies are compared. It can be seen that 
little differences exist in overall student engagement and 
non-engagement rates, although we know from the previous table th*t the 
MMH students are less likely to be successful during math and reading 
activities. Some differences are apparent in the teacher behavior 
comparisons. MMH teachers spend proportionally somewhat more time 
questioning,. providing needed explanations, planned explanations, and 
structuring/directing than do teachers of normal students, resulting in 
12 percent more direct instruction for MMH students. Knowing the very 
strong relationship between direct instruction and student engagement (p 
= .95 — 2ee previous section), one can hypothesize that, had the MMH 
students not received more direct instruction, their engagement rates 
would have been lower by about 10 percent. Moreover, the increased 
direct instruction can be often attributed to time spent in the resource 
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Table 11. STUDENT AND INSTRUCTOR BEHAVIORS 



HANDICAPPED 
(CITH) 
READING/MATH 



NORMAL 
(BTES) 
READING/MATH 



STUDENT BEHAVIORS: 










Engaged - Written 

- Oral 

- Covert 

- Directions 
TOTAL ENGAGEMENT 


38 
16 
41 

Q 

V 

103 


28 
11 
29 
6 
75 


NOT 
AVAILABLE 

101 ~73 


Not-Engaged Interim 

- Wait 

- Off-Task 
TOTAL NON- ENGAGEMENT 


£ 

J 

7 
24 
36 


3 
5 

17 
25 


NOT 
AVAILABLE 

37 27 


INSTRUCTOR BEHAVIORS: 










Academic - Monitoring 


J 


2 




* 


- Feedback 


18 


13 


19 


13 


- Questioning 


15 


11 


9* 


7* 


- Needed Explanation 


4 


3 


2 


1 


- Explanation - Planned 


5 


4 


'3 


2 


- Structuring/Directing 


9 


7 


7 


5 


- Task Engagement Feedback 


_2 


_2 


__3 


_2 


TOTAL DIRECT INSTRUCTION 


57 


42 


42 


30 


NON-DIRECT INSTRUCTION 


82 


58 


96 


70 



* = Combined (AM + AQ) 
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room or self-contained classroom, where class sizes are normally much 
smaller, allowing teachers to give more attention to individual students 
and small groups • 

In Table 12, time spent in various educational activities is 
reported for the MMH students in our study only (the BTES study did not 
code activities the same way we did, so no comparts ions are possible). 
These results essentially recapitulate those presented earlier, except 
that data from Year 1 only were used, so that time in minutes per day 
could be legitimately estimated. Note also that percent time adds to 100 
percent for each classification (e.g., for pacing, for task success in 
reading, etc.), so that one can compare the relative amount of time 
spent in categories in each classification. 

In Table 13, MMH student and teacher behavior results are given. 
These repeat information from Table 11, with the addition of standard 
deviations, to give the reader a feeling for the variances. 

Relationships between ALT and Achievement 

Analysis of relationships among ALT measures themselves have been 
presented above. What is the relationship between ALT and academic 
achievement gains? To answer this question and for comparative purposes 
regression analyses were performed following the pattern 0 f those in the 
Fisher, et al. (1978) study. The reader should note the implications of 
the linear assumptions inherent in the regression model, since these 
assumptions may be necessarily restrictive. Furthermore, beta weights in 
regression analysis are notoriously unstable in small samples, leading 
research methodologists to recommend fairly large sample sizes (e.g., 
greater than 100). In our study, the total n for the regression analyses 
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Table 12. YEAR 1 ALTOS RESULTS (n * 24): EDUCATIONAL ACTIVITY DESCRIPTIVE STATISTICS 



TARGET STUDENT (n = 24) 
PACING 

- Self-paced 

- Other-paced 

PREDOMINANT STUDENT TASK 

- Oral Reading 

- Silent Reading 

- Reciting * 

- Listening 

- Discussing 

- Writing 

- Other 

TASK SUCCESS IN READING 

- High 
-Medium 
-Low 

TASK SUCCESS IN MAT E 

- High 

- Medium 

- Low 

T ASK SUCCESS IN ALL ACTIVITIES 

-High 

-Medium 

-Low 



MIN/DAY 
MEAN S.D. 



PERCENT TIME 
MEAN S.D. 



127.3 
115.4 



11.1 
39.0 

5.2 
53.8 

1.6 
52.7, 
68.2 



25.2 
43.0 
11.4 



9.5 
20.0 
6.7 



75.5 
75.2 
20.4 



35.3 
30.2 



9.9 
23.4 

5.3 
20.4 

2.9 
18.0 
26.6 



16.4 
13.7 
14.6 



9.2 
15.3 
6.9 



38.. 0 
27.2 
17.8 



52.2 
47.8 



4.7 
16.7 

2.3 
23.3 

0.7 
22.6 
29.6 



30.7 
55.8 
13.5 



25.9 
52.7 
21.4 



42.9 
44.6 
12.4 



13.1 
13.1 



4.5 
10.0 

2.3 
.8.7 

1.3 

6.4 
12.1 



16.6 
15.5 
13.2 



22.2 
26.4 
23.5 



15.9 
14.1 
10.1 



TARGET STUDENT INSTRUCTOR 



INSTRUCTOR (OF TARGET STUDENT) 

- Teacher 

- Peer 

- Adult Aide 

- Self-instructional Material 

- Teaching Machine 

- No Instructor 



137.6 
3.2 
9.3 
4.1 
8.1 
66.8 



30.6 
6.5 

10.1 
5.0 
6.1 

31.7 



60.1 
1.4 
4.2 
1.8 
3.6 

28.9 



11.5 
3.0 
4.5 
2.4 
2.7 

12.0 



PREDOM I NANT INSTRUCTOR TASK 

- Lecturing 

- Discussing 

- Prompting 

- Modeling/Demo 

- Testing 

- Supervising 

- Other 



16.2 
10.9 
39.4 
18.5 
16.2 
106.4 
23.6 



12.4 
8.7 
19.3 
12.0 
13.0 
25.8 
23.2 



7.2 
4.6 

17.4 
8.0 
6.7 

46.3 
9.7 



5.7 
3.6 
9.5 
5.5 
5.3 
11 .1 
8.9 
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Table 12 (Continued) 



102 





MIN/DAY 


PERCENT 


TIME 


PRIMARY LUNJ ENT AREA 


MEAN 


S.D. 


MEAN 


S.D. 


KtAUIiNU/ LANGUAGE ARTS 










- Decoding/Phonics 


7.3 


6.8 


2 1 


2 1 


- Word Structure 


3.8 


9.0 


1 0 


2 1 


- Word Meaning 


8.7 


10.7 


2 5 


j • w 


- Comprehension 


10.0 


7.3 


2 8 


2 0 


- Reading Practice 


15.4 


11.6 


4.1 


2.9 


- Spelling 


10.0 


9 0 


2.8 


2.0 


- Grammar 


6.0 


7.9 


1 • 0 


9 0 
Z • Z 


- Composition 


3.7 


4.8 


1 0 
x • \J 


1 1 

X.J 


- Reading Related 


15.8 


13.7 


4.2 


3 S 


- Reading Below Test Level 


8.8 


11.5 


2 A 


J . X 


MATHEMATICS 










- Add . /Subtract . , No Ke-grp. 


2.8 


6.2 


0 8 


1 Q 
x . y 


- Add. /Subtract. , No Re-grp. 


2.0 


3.7 


0 6 


1 2 

X ♦ L. 


- Computational Transfer 


2.5 


8.7 


0 6 


2 2 


- Place Value/Numeration 


0.7 


1.9 . 


0 2 


0 s 

w . J 


- Multiplication 


5.4 


6.5 


1 5 

X • ^ 


1 Q 
x . y 


- Division 


7.4 


11.3 


2.0 


3.0 


— Fractions/Decimals 


3.0 


7 3 


0.8 


1.9 


- Spatial Application 


1.8 


4.9 




X . J 


- Word Problems 


1.5 


3.0 


0 4 


0 8 


- Math Related 


12 . 1 


9.9 




2 S 
£ • j 


- Math Below Test Level 


2.3 


5.9 


0.6 


1.6 


OTHER ACADFMTC 










- Science 


3.5 


4 .2 

""f . mm 


n q 


1 • Z 


- Social Studies 


19.8 


23 2 

£m J . mm 


j • z 


j • y 


- Foreign Language 




X . 7 


U • I 


U.J 


NON-ACADEMIC 










- Art 


12.9 


7.6 


J.J 


9 1 
Z ♦ x 


- Music 


11.7 


7.1 


^ 2 

J • mm 


1 8 
X . o 


- Technological Arts 


0.2 


1.0 


0 1 

W • X 


U.J 


- Physical Education 


11.3 


8.5 


3.1 


2.2 


- Perceptual Development 


2.5 


6.8 


0.7 


1.8 


- Management/Procedural 


12.8 


9.0 


3.5 


2.5 


- Recreation/Break 


89.1 


31.2 


24.0 


7.8 


- Personal Experiences/Feelings 


2.5 


3.4 


0.7 


0.9 


- Other 


18.9 


12.7 


5.1 


3.4 



TOTAL READING 
TOTAL MATH 

TOTAL OTHER ACADEMIC 
TOTAL "NON-ACADEMIC* 

(Missing/Unknown Content) 
TOTAL TRANSITION TIME 

TOTAL TIME PER DAY 



89.6 
41.3 
23.7 
161.8 
4.5 
46.7 

367.6 




24.5 
11.3 

6.3 
45.3 

1.4 
12.7 



7.2 
4.1 
6.2 
11.6 
2.5 



30.0 



* NOTE: Total Non-Acad(*mic includes Recreation/Break and Management/Procedural 
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Table 13. YEAR 1 ALTOS RESULTS : TARGET STUDENT AND INSTRUCTOR BEHAVIOR 

DESCRIPTIVE STATISTICS 





MO/DAY 




PERCENT 


TIME 




MEAN 


S.D. 


• 


Ml? AM 




TARGET STUDENT 






/ 






engaged - written 


37.7 


12.2 




27.8 


7.2 


- Oral 


15.7 


7.6 




11.5 


5.4 


- Covert 


40.5 


16.0 




28.9 


7.9 


- Directions 


8.6 


2.7 




6.4 


2.1 


TOTAL ENGAGEMENT 


102.5 


25.8 




74.6 


8.6 


Non-Engaged - Interim 


4.6 


2.0 




3.4 


1.3 


- Waiting 


6.8 


4.3 




5.0 


3.0 


- Off-Task 


24,. 4 


17.5 




17.0 


9.3 


TOTAL NON- ENGAGEMENT 


35.7 


17.9 




25.4 


8.6 


INSTRUCTOR 








< 




Non-Direct Instruction 


81.6 


27.0 




58.5 


10.? 



Academic 


Monitoring 


Academic 


Feedback 


Academic 


Questioning 


Academic 


Explanation-Needed 


Academic 


Exp lana t ion-P lanned 


Academic 


Structuring/Dir . 


Academic 


Tack Engagement FB 


TOTAL 


DIRECT ACADEMIC INSTRUCTION 



3.1 
18.3 
14.9 
4.2 
5.0 
8.7 
2.4 
56.6 



2.3 
8.4 
7.5 
2.6 
4.0 
2.8 
2.0. 
18.6 



2.4 
13.0 
10.9 
3.0 
3.7 
6.6 
1.9 
41.5 



1.7 
5.1 
4.8 
1.5 
3.1 
2.2 
1.8. 
10.2 



FOCUS 

Target Student 

Group w/ Target Student 



24.3 
32.3 



11.1 
19.4 



18.8 
22.7 



9.2 
11.9 
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was 44. For purposes d£ cross-validation, the sample was divided into 
two halves (Groups A and B, n = 22 in each! by random selection, so that 
stability of regression coefficients could be studied. . As a caveat in 
advance, the reader\hould note that the following analyses are subject 
to the classical problem of instability of beta weights. Therefore, 
conclusions from these analyses should be viewed as tentative rather 
than definitive V 

Achieveme nt measures . Four achievement tests were administered at 
pretesting and posttesting occasions: the Sterling Math Test (of 

# 

arirVietic computational skills), the Silvaroli Reading Inventory, the 
Stanford Diagnositic Math Numeration Subtest, and the Stanford 
Diagnostic Reading Comprehension Subtest. Tests were given during a 
one-week interval in two to three sittings by trained testers. Levels of 
the Stanfords were selected according to student ability levels as 
indicated by their teachers. If a level was too high or too low at 
pretest time, the next level down or up was readministered at a 
different sitting, in order to control for floor and ceiling effects. 
Scores on the Stanfords were converted to scaled scores, using the norms 
provided by the test developers, in order to achieve comparability of 
scores across the four different levels. 

The Sterling Math Test consists of thirteen subtests. These were 
combined resulting in four subtests as follows: addition/subtraction 
with no regrouping, addition/subtraction with regrouping, multiplication 
and division. Thus, the four subtests directly paralleled respective 
content coding categories on the ALTOS , so that time students were 
observed in activities coded by these categories could be directly 
compared to the Sterling results in regression analyses. For each 

119 
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subtest, two different scores were constructed: fluency and accuracy. 
Fluency refers to the number of problems solved correctly during a 
one-minute timing ( i.e. , it is a rate measure). Accuracy refers to the 
percent of problems attempted which were solved correctly, since there 
were many more problems on a given subtest than any student could 
complete during a one-minute timing. Thus, accuracy scores reflect the 
extent to which the student correctly performs the arithmetic operation, 
whereas fluency reflects how rapidly correct performance occurs. When 
more than one of the original subtests were combined into a single 
subtest corresponding to the ALTOS content code, a' composite average 
score was constructed. 

The Silvaroli Reading Inventory consists of three purportedly 
parallel versions (A, B and C). Dale-Chall, Spache and Harrison-Jacobs 

i 

readability formulas were used to estimate the difficulty l^vel of the 
reading passage at each designated grade level' for each version. Some 
discrepancies in grade levels of passages were discovered, according to^ 
readability indices, in each version. Thus, a single version was 
constructed, using passages from the three original versions, which had 
readability levels spaced approximately the same distance apart across 
the 10 ordered grade levels (pre-primer through grade 8). The inventory 
was administered to students following the guidelines set forth in the ' 
administrator's manual, until a scores were obtained for independent, 
instructional and frus trationai levels, respectively. For each of these 
three levels, the following measures were constructed: fluency, 
accuracy, and errors. Fluency refers to the number of words read 
correctly per minute. Accuracy refers to percentage of words read 
correctly. Errors refers to the number of words read incorrectly 
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(miscues) per minute. Since the same three levels may not have been 
administered during the posttest, due to increases in student oral 
reading proficiency', and since not all students were tested on the same 
three levels, it was necessary to devise a method of scaling so that 
comparability of, student reading proficiency both within and among 
students was possible. Three composite scores were constructed for 
fluency, accuracy and error measures, respectively. Each composite was 

r 

formed by taking the harmonic mean of the three levels for a given 
student on a given testing occasion, where the weighting factors were 
the grade level equivalents derived from the readability indices -for the 
passages involved. Thus, easier passages (i.e., lower grade levels) 'were 
given less weight relative to harder passages (i.e., higher grade, 
levels). If this or a similar scaling method were not employed, then it 
would be difficult to compare, for example, a^ student who read a 6th 
grade ^passage^t 70 words per minute to a student who read a 1st grade 
passage at 100 words per minute, since the difficulty levels of those 
passages are quite different. This problem is analogous to comparison of 
scores from different levels of the Stanford Diagnostic Tests, and the 
resulting need for scaled scores. 

'In Table 14 means and standard deviations are reported for pre- and 
.post tests for the 13 measures of math and reading achievement (for 
o - groups A and B and the total (A+B).\ Correlations between pre- and 

posttest scores are also given. T: should be noted that these 
correlations tend to be very high— often .90 or higher. This fact is 
significant for regression analysis, when the pretest is used as a 
covari'ate entered first into the equation, so as to result in very 
little residual Variance (unaccounted for by the pretest) to explain-by 

■ 

* 

ERJC - " ' 121 



108 



Table 14. ACHIEVEMENT SCORES (PRE- AND POSTTEST)— YEAR 1 and 2 COMBINED RESULTS 



ACHIEVEMENT MEASURE 



GROUP* 



PRETEST 
MEAN S.D. 



POSTTEST 
MEAN S.D. 



PRE /POST 
CORRELATION 



1. Addition /Sub tract ion 

(No Regrouping) FLUENCY 



\ 



2\ Addition/Subtraction 

(No Regrouping) ACCURACY 



3. Addition/Subtraction 

. . (w/ Regrouping) FLUENCY 



4. Addition/ Sub tract ion 

" (w/ Regrouping) ACCURACY 



5. Multiplication FLUENCY 



6. Multiplication ACCURACY 



7. Division FLUENCY 



8. Division ACCURACY 



9. SDMT MATH NUMERATION 



10. SDRT READING COMPREHENSION 



li: IRI Reading FLUENCY (n=33) , 



12. IRI Reading ERRORS (n=33) 



13. IRI Reading ACCURACY (n=39) 



ERJC for total group » 44. Groups A & B 
s "™~~\N !a 22 each) for cross-validation. 



A 
B 

TOTAL 


111.5 
104.2 
107.8 


75.1 
75.0 
74.3 


113.3 
129.6 
J 21. 4 


74.9 
89.7 
82.1 


.96 
.95 
.94 


A 
B 

TOTAL 


82.6 
79.4 
81.0 


29.5 
26.9 
28.0 


84.0 
84.7 
84.3 


28.1 
22.2 
25.1 


.95 
.86 
.91 


A 
B 

TOTAL 


15.3 
15.0 
15.1 


13.7 
14.3 
13.9 


16.6 
16.2 
16.4 


14.6 
14.9 
14.6 


.91 
.96 
.94 

• 


A 
B 

TOTAL 


59.1 
61.2 
60.1 


43.1 
40.1 
41.2 


64.4 
64.9 
64.6 


39.2 
39.4 
38.8 


.84 
.92 
.88 


A 
B 

TOTAL 


41.6 
35.3 
38.5 


50.2 
47.3 
48.3 


47.5 
50.0 
48.8 


52.1 
54.0 
52.5 


.96 
.86 
.91 


A 
B 

TOTAL 


4f) 8 
34.5 
37.6 


J J . o 

34.5 
34.9 


LI 0 

45.4 
46.6 


A 1 1 

40.6 
40.4 


on 

• yu 
' .78 
.84 


A 
B 

TOTAL 


L 7 
7.1 
5.9 


D • D 

11.9 
9.6 


7 Q 

8.5 
8.2 


y. j 
11.5 

10. > . 

u 


o c 
. 86 

.82 

.82 


A 
B 

TOTAL 


32.4 
, 32.5 
32.5 


39.8 
41.4 
40.2 


41.3 
46.5 
43.9 


46.0 
48.7 
46.9 


.92 
^ .71 
. .81 


A 
tv 












' B 
TOTAL 


244.4 


77.3 


261; 8 


60.7 


.93 


A 




• 








B 

IU1 AL 


Ten /. 

352 . 4 


1UU. / 


361. 0 ... 


101. 0 


- 

.97 


A 
B 

TOTAL 


49.9 


33.6 


55.5 


37.4 


.91 


A 












B 

TOTAL 


8.4 


8.6 


6.5 


3.6 


.30 


A 
B 

TOTAL 












77.2 


21.4 


82.0 


18.4 


.87 



formed by randomly dividing total in half 
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any ALT variables. When pre/post correlations are high, little residual 
variance is left to be accounted for. This problem is well known in the 
literature, and is in part due to the nature of correlational analysis 
and in part to the nature of the measures employed. Standardized test 
scores are especially problematic when estimating achievement gains due 
to the typically very high correlation between pre- and posttests. 
Nonetheless, there is some variance left to try to account for, albeit 
small, in the following regression analyses. 

In Table 14 it can be seen that the posttest means are higher than 
the pretest means for each achievement measure and group, the one 
exception being for reading errors , which would be expected to decrease, 
as they did. In general, however, achievement gains tend to be rather 
small. Furthmore, standard deviations are roughly of the same magnitude 
as their respective means, indicating a great deal of Variability in the 
distributions of scores. This should not be surprising, since the sample 
includes MMH students ranging in age from 6 to 13 -years in grades 1 
through 5. 

ALT measures. Twelve measures of ALT were constructed for each set 
of regression analyses: proportions of student engagement during high, 
medium and low task success activities; total student engagement; direct 
instruction during high, medium and low task success activities; total 
direct instruction; high, medium and low task success activities; and 
total time allocated. 

For each set of analyses (e.g. , see Tables 15 - 27), only 
observational data relative to the type of achievement measure were 
used. For example, for multiplication fluency, only those activities 
coded on ALTOS as multiplication as the primary subject matter were used 
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in the analysis. Each of these activities was coded as either a high, 

/ 

medium or low task success activity, depending on how well the stuent 

performed during the activity. Student engagement during high task 

/ 

success activities in multiplication (for example) is indicated by the * 

/ 

proportion of time that the student was observed on-task during 
multiplication activities in which s/he made very few or no errors. 
Similar proportions were formed for student engagement during medium and 
low task success activities. Total-student engagement is indicated by 
the proportion of time the student was on-task /during activities in 
which multiplication was the primary subject matter, regardless of task 
success. Similar proportions were formed for direct instruction. 
Although direct instruction is not an ALT measure per se, it was found 
to be highly related to student engagement in an earlier analysis, and 
thus was included here to see whether it was also related to gains in 
student achievement. High task success was indicated by the amount of 
time accumulated for multiplication activick : which the student made 
very few or no errors, divided by the total time allocated to 
multiplication--^. e. , it is the , proportion of time high task success was 
experienced during multiplication activities. Proportions were similarly 
formed for medium and low task success. Finally, the total task success 
time (bottom right cell) indicates the total time allocated to the 
content area (e.g., multiplication), divided by the total time 
observed— i.e. , it estimates the relative proportion of total school 
time allocated to that content area. It was necessary to convert all ALT 
measures to proportionate times, since not all students were observed 
for the same to^al amount of time. Although it would have been ideal to 
know the actual amount of time spent on a particular content area 
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between pre- and posttests, this was logistically impossible. One could 
estimate such an amount of time, given the days of observation sampled, 
by multiplying the proportion of time in a content area by the number of 
days between pre- and posttesting. However, since the pre/post intervaj! 
was essentially the same for all students (plus or minus two weeks), the 
amount of estimated time would be almost perfectly correlated with the 
proportion of time that that activity content area was observed. 
Therefore, nothing would be gained by the latter pro-rating procedure. 

Partial c orrelation coefficients . Partial correlation coefficients 
are reported in Tables 15 through 27. Each of these is the correlation 
of a particular ALT-variable with the posttest variable after the 
effects of the pretest variable have been partialled out (of both the 
posttest and that ALT variable). In effect, the pretest variable is 
statisically controlled for. Moreover, the square of the partial 
correlation coefficient indicates the proportional amount of remaining 
variance that would be additionally accounted for if that variable were 
entered next into the regression equation, after having first entered 
the pretest variable. A correlation of .30 or higher is statistically 
significant with an n of 44 (p < .05) for the total group; a correlation 
of .43 or higher is significant with an n of 22 (p < .05) for groups A 
and B. 

ALT and addition/subtraction with no regrouping — FLUENCY . None of 
the partial correlations were significant between any of the ALT 
variables and fluency in addition/subtraction computations involving no 
regrouping, although total time allocated (r = ,24) and total student 
engagement time (r - .23) were positive. See Table 15. The reader should 
note the instability of the partial correlation coefficients in groups A N 
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Table 15. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUAL IZED GAINS IN 

STUDENT ACHIEVEMENT* 
Addition/Subtraction (No Regrouping) — Fluency 



Time in Activities 
Variable Group** 


in Which Task Succes Was: 
High Medium Low 


Total 
Time 


Student Engagement A 

B 

TOTAL 


.35 ' .29 -.07 
-.01 .33' .06 
' .14 .25 -.01 


.37 
.17 
.23* 


Direct Instruction A 

B 

TOTAL 


.29 . 36 -.07 
.20 .21 .29 ' 
.24 .20 .02 


.21 
.28 

' .22 


Task Success A 

B 

TOTAL 


.37 .29 -107 
-.07 .38 .05 
.12 .26 -.02 


.26 
.22 
.24 



□ - P < .05 



Partial correlation coef ficents— i.e. , correlation of variable with 
post test f other after accounting for variance due to pretest. 

N for total group » 44. Groups A & B formed by randomly dividing total 
in half (N=22 each) for cross-validation. 
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Table '16. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 
Add it ion /Sub tract ion (No Regrouping) — Accuracy 

Time in Activities in Which Task Success Was: 



Variable 



Group** 



High 



Medium 



Low 



Total 
Time 



Student Engagement 



A 
B 

TOTAL 



.61 


.12 


-.20 


.66 


.33 


.06 


.66 


.24 


-.22 



.34 



760 



.43 



Direct Instruction 



A 
B 

TOTAL 




-.08 
fTsTl 
.21 



Task Success 



A 
B 

TOTAL 



.52 


.12 


-.18 


.57 


.32 


.08 


.58 


.23 


-.20 



.70 



.58 



.64 



* Partial correlation coefficients — i.e., correlation of variable with 
posttest, after accounting for variance due to pretest. 

** N for total group = 44. Groups A & B formed by randomly dividing 
total in half (N=22 each) for cross-validation. 
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Table 17. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 

Addition/Subtraction (W/ Regrouping) - 7 Fluency 
Time in Activities in Which Task Success Was: 

\ 



Variable 


Group** 


High 


Medium 


Low 


Total 
Time 


Student Engagement 


A 


.22 


.26 




.30 




B 

TOTAL 


-.17 
.08 


.19 
.18 


-.14 
-.08 


.03* 
.14 


Direct Instruction 


A 


.14 


.27 




.27 




B 

TOTAL 


-.26 
.01 


.05 
.17 


-.15 
-.09 


-.18 
.09 


Task Success 


A 


.27 


.27 




.21 




B 

TOTAL 

t 


-.24 
.10 


.17 ' 
.17 


-.13 
-.08 

■ 


-.09 
.07 



* Partial correlation coefficients— i.e. , correlation of variable. with 
posttest, after accounting for variance due to pretest. 

* N for total group = 44. Groups A & B formed by randomly dividing total 
total in half (N=22 each) for cross-validation. 
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Table 18. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* , 
Addition/Subtraction (W/ Regrouping) — Accuracy 
Time in Activities In Which Task Success Was: 



Variable 










Total 


Group** 


High 


Medium 


Low 


Time 


Student Engagement 


A 


.14 


.00 




.10 




B 


.28 


-.05 


.27 


.21' 




TOTAL 


.07 


-.01 


.13 


.16 


Direct Instruction 


A 


.13 


-.08 




.04 




B 


.OA 


-.23 


.29 


.00 




TOTAL 


.22 


-.13 


.15 


.05 


Task Success 


A 


.14 


-.03 








B 


.28 


-.03 


-.28 






TOTAL 


.22 


-.02 


.12 


.14 



* Partial correlation coef f icients— i .e. , correlation of variable with 

posttest, after accounting for variance due to pretest. 

i . . 

* N for total group = 44. Groups A & B formed by randomly dividing total 
in hald (N = 22. each) for cross-validation. 
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and B. Only partial correlation coefficients for the 'total sample are * 
discussed here. 

ALT and addition/subtraction with no regrouping — ACCURACY . The 
pre/post correlation was .91 for the total sample, leaving about 18 
percent of the variance unaccounted fori Significantly positive partial 
correlatio'ns were found for total time allocated (r = .64), total 
student engagement (r = .48) and high task success (r = .58). See Table 
16. 

ALT and additi on/subtraction with iegrouping — FLUENCY and ACCURACY . 
None of the correlations of ALT variables with achievement scores were' 
significant here. Total time allocated and total student engagement time 
were positively correlated with fluency and accuracy in 
addition/subtraction computations involving regrouping, but 
non-significant. See Tables 17 and 13. 

ALT and multiplication— FLUENCY . Medium task success (r = .44), 
student, engagement in medium task success activites (r = .53), total 
student engagement (r = .51) and total direct instruction (r = .37) were 
significantly and positively related to achievement scores on 
multiplication fluency. Total time allocated and high task success were 
also positively related to achievement but non-significant. See Table 
19. 

ALT and multiplication— ACCURACY . Total time allocated (r = .50) and 
total student engagement (r = .40) were significantly and positively 
related to achievement in multiplication accuracy. Total direct 
instruction was also positively related to achievement (r = .34). See 
Table 20. 
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Table 19. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUAL I ZED GAINS IN 

STUDENT ACHIEVEMENT* 
Mult ! n j.ication — Fluency 
Time in Activities in Which Task Success Was: 



Variable 



Group** 



High 



Medium 



Low 



Total 
Time 



Student Engagement A 

B 

TOTAL 




Direct Instruction 



Task Success 



A 
B 

TOTAL 



.22 
.26 
.24. 



A 


.10 


.26 


.16 


B 


.07 


.49 


.13 


TOTAL 


.07 


.41 


.10 



.31 



.53 



.44 



.12 
-.06 
.01 



.34 
.57 
.51 



.31 
.43 
.37 



.39 
.08 
.16 



* Partial correlation coefficients— i.e. , correlation of variable with 
posttest, after accounting for variance due to pretest. 

* N for total group = 44. Groups A & B formed by randomly dividing total 
in half (N=22 each) for cross-validation. 
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Table 20. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUAL I ZED GAINS IN 

STUDENT ACHIEVEMENT* 
Multiplication — Accuracy 

Time in Activities in Which Task Success Was: 



Variable 


Group** 


High 


Medium 


Low 


Total 
T Line 

* 


Student Engagement 


A 
B 

TOTAL 


.14 
.15 
.14 


.11 

.39 

urn 


.02 

ED 

.29 


.17 
.50 
.40 




Direct Instruction 


A 
B 

TOTAL 


.19 
.12 
.15 


.28 
.16 
.21 


.04 
|. 6pj 


.34 
.33 

m 


Task Success 


A 
B 

TOTAL 


.16 
'.25 
.21 

4 


.15 
.33 
.28 


.01 

.23 


.39 
.53 
.50 





* Partial correlation coef ficdents--i.e. , correlation of variable with 
posttest, after accounting for variance due to pretest. 

** N for total group = 44. Groups A & B formed by randomly 'dividing total 
injialf (N=22 each) for cross-validation. 
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ALT and division — FLUENCY . Total time allocated (r = .50), total 
student engagement (r = .32) and high task success (r = .43) were 
significantly and positively related to achievement in division fluency. 
See Table 21. Note also that student engagement during high task success 
activities (r = .42) and direct instruction during high task success 
activities (r = .49) were significantly and positively associated with 
division fluency achievement. 

ALT and di vision— ACCURACY . Total time allocated (r = .43) and 
direct instruction in high task success activities were both 
signficantly and positively correlated to achievement in division 

v.- 

computational accuracy. 

ALT and math . numeration . Note that data were available for Year 2 
students only here (n = 20), and that the pre/post correlation left 14 
percent resfdual to predict. No significant correlations were found, 
although some trends were evident. Note also that ALTOS data were 
necessarily aggregated across all math activities observed, since the 
numeration subtest of the Stanford Diagnostic Math Test covers multiple 
content areas that were coded on ALTOS. In other .words , this constituted 
a less refined analysis, compared to the results of the Sterling Math 
Test where direct correspondences between ALTOS content codes and 
subtests existed. This fact, along with the high pre/post correlation on 
the Stanford (r = .93), may explain why there were no significant 
results with the standardized measure , but there were many with the 
criterion-referenced measure (Sterling). See Table 23. 

ALT and reading comprehension . Note here, as above, data were 
available only for 20 Year 2 student*; thus, with such a small sample 
for regression, only very tentative conclusions may be drawn. ALTOS data 
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Table 21. CORRELATION OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 

/ 

Division — Fluency 
Time in Activities in Which Task Success Was: 



Variable 



Student Engagement 



Direct Instruction 



Task Success 



Group** 


High 


Medium 


A 




.13 


-.06 


B 




.69 


-.07 


TOTAL 




.42 


-.00 



A 
B 

TOTAL 



A 
B 

TOTAL 



.28 



.69 



.49 



19 



68 



,43 



-.03 
-.10 
-.08 



-.06 
-.05 
.02 



Low 



.61 



.04 
.17 



.60 



.30 



.66 



.01 
.17 



Total 
Time 



.16 
.40 

cm 



.27 
.29 
.27 



. .38 



* Partial correlation coefficients— i.e. , correlation of variable with 
posttest, after accounting for vardancr due to pretest. 

** T f u r n ^°^ al gr ° UP = 44, Groups A & B- formed by randomly dividing total 
in half (N=22 each) for cross-validation. 
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Table 22. CORRELATION OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 
Division — Accuracy 
Time in Activities in Which Task Success Was: 



Variable Group** 


High Medium- Low 


Total 
Time 


Student Engagement A 

B 

TOTAL 


.15 -.05 .42 
.25 .16 -.07 ' 
.20 .09 .05 


.15 
.26 • 
.21* 


Direct Instruction A 

B 

TOTAL 


.36 -.11 .41 
.41 -.06 -.04 
1 -37| 7 .08 .1.5 


.23 
.16 
.18 


Task Success A 

B 

TOTAL 






•21 -.06 Va9] 




.22 .16 »-.09 
.19 .06 .05 


.33 

cm 



* Partial correlation coefficients— i.e. , correlation of variable with 
posttest, after accounting for variance due to pretest. 

** N for total group = 44. Groups A & B formed by randomly dividing total 
in half (N=22 each) for cross-validation. 
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Table 23. CORRELATION OF ALTOS VARIABLES WITH RE SI DUAL I ZED GAINS IN 

STUDENT ACHIEVEMENT* 
Stanford Diagnostic Math Test— Numeration 



Variable 


Group** 


High 


Medium 


Low 


Total 
Time 


Student Engagement 


A 
B 

TOTAL 

— 7 — 


.21 


.15 


-.14 


.16 

• 


Direct Instruction 

— — ■ — ' — Jf 


A 
B 

TOTAL 



.07 


-.25 


-.18 


MM 

-.16 


Task Success 

• 


A 

B 

TOTAL 
1 


.16 


.24 


-.11 


-.07 



* Partial correlation coefficients--!. e. , correlation of variable with 
posttest, after accounting for variance due to pretest. 

** N = 20, Year 2 students only. 
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were aggregated for activities that were coded as reading comprehension, 
reading practice and word meaning, either as the primary or secondary 
content area. However, reading comprehension as a construct is less well 
understood and more difficult to measure than a skill such as arithmetic 
computation. As can be seen in Table 24, no significant partial 
correlations were found between ALT variables and achievement scores in 
reading comprehension. It would. be difficult for any significant 
correlations to occur, since the pre/post correlation on the Stanford 
Reading Comprehension Subtest was .97, leaving a mero 6 percent of 
variance in the posttest unaccounted for by the pretest. 

ALT and oral reading fluency. The pre/post correlation here was .91, 
leaving 18 percent residual variance. Medium task success was 
significantly negatively correlated (r = -.48) with achievement scores 
in oral reading fluency. Similar negative correlations were found for 
3tudent engagement and direct instruction in medium task success 
activities. High task success was positively related to achievement but 
not statistically significant. Even more puzzling is that total student 
engagement time is significantly negatively related to achievement in 
reading fluency. See Table 25. This latter finding is contrary to the 
general ALT hypothesis. These results imply that MMH students who are 
engaged a greater percentage of the time allocated to reading activities 
•tend to gain less in oral reading fluency. 

ALT and oral reading errors. Here the results seem to make more 
sense. One would expect to find a negative relationship, since 
achievement "gains" are indicated by reductions in error rates. See 
Table 26. Two correlations were significant in the expected direction: 
student engagement during high task success activities (r = -.31) and 
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Table 24. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 
Stanford Diagnostic Reading Test— Comprehension (Scaled Scores) 
Time in Activities in Which Task Success Was: 



Variable 


Group** 


High 


Medium 


Low 


Total 
Time ' 


Student Engagement 


A 
B 

TOTAL 


.05 


.28 


-.21 


mm 

.11 


Direct Instruction 


A 

B 

TOTAL 


-.29 


.39 


-.26 


-.11 


Task Success 


A 
B 

TOTAL 


.29 


.30 


-.21 


-.34 



* Partial correlation coefficients— i.e. , correlation of variable with 
posttest, after accounting for variance due to pretest. 

** N=20, Year 2 students only.. 
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Table 25. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 
Stanford Diagnostic Reading Test— Reading Fluency (words per minute) 
Time in Activities in Which Task Success Was: 



Variable 



Total 
Time 




r 

* Partial correlation coefficients— i.e. , correlation of variable with 
posttest, after accounting for variance due to pretest. ' 

** N=33, Years 1 and 2 combined. 

«« 
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Table 26. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUAL I ZED GAINS IN 

STUDENT ACHIEVEMENT* 
Reading Errors (Words Per Minute) 
Time in Activity in Which Task Success Was: 



Variable 


Group** 


High 


Medium 


Low 


Total 
Time 


Student Engagement 


A 
B 

TOTAL 


m 


.09 


.04 


* 

fc£l 


Direct Instruction 


A 












B 












TOTAL 

A 


-.29 


.11 


-.01 


-.21 


Task Success 


A 










" 1 1 / — ■ — 


B 

TOTAL 


-.22 


.16 


.10 


.05 



Partial correlation coefficients— i.e. , correlation of variable with * 
posttest, after accounting for variance due to pretest. 

N - 33, Years 1 and 2 combined.. 
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total engaged time (r = -.33). Other similar trends were evident but 
failed to reach significance (e.g., high task success). 

ALT and oral reading accuracy . No significant correlations weije 
found between any of the ALT variables and achievement scores on oral 
reading accuracy, though expected positive trends do occur. See Table 
27 . 

Final caveat. Regression analysis is limited by assumptions of 
linearity. Moreover, causal inferences are not warranted from 
correlational data. The reader should also note that mid-year posttests 
were used, with the Year 2 students rather than end-of-year posttests for 
two reasons: 1) to prevent confounding by interventions that occurred 
right after the Year 2 mid-year posttests, and 2) so that the pre/post 
interval was roughly equivalent to , that in Year 1 in order to combine 
the two samples. 

Conclusions. Despite the limitations mentioned above, the results 
are encouraging. The findings between the relation of ALT and 
achievement for mildly handicapped students are very similar to those 
found for normal students in the Fisher, et al. (1978) BTES study. In 
fact, the magnitudes of partial correlation coefficients are often 
greater than those reported in the BTES study, thus "explaining" more of 
the residual variance in achievement scores. Had the sample size been 
three times as large in our study (making it roughly the same size as 
the BTES sample), and if the partial correlation coefficients remained 
constant, then many more would have been statistically significant. 
Given the overall consistency of our findings with those of the BTES 
study of normal children, despite our smaller sample size, it would 
appear that on the whole, the relationship of ALT and academic 
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Table 27. CORRELATIONS OF ALTOS VARIABLES WITH RESIDUALIZED GAINS IN 

STUDENT ACHIEVEMENT* 
Reading Accuracy (pet. Correct) 



Time In Activities in Which Task Success Was: 



Variable 



Group*''* 



High 



Medium 



Low 



Total 
Time 



Student Engagement 



A 
B 

TOTAL 



.09 



.06 



.05 



.26 



Direct Instruction 



A 

B 

TOTAL 



09 



.03 



.09 



,19 



Task Success 



A 

B 

TOTAL 



.12 



.01 



-.01 



.13 



* Partial correlation coefficients — i.e., correlation of variable with 
posttest, after accounting for variance due to pretest. 

** N = 39, Year 1 and 2 combined. 
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achievement in reading and math obtains for mildly handicapped students 
as we 1 1 . 

Results from N a l Experiments 

In both Years 2 and 3, experimental interventions were undertaken 
with participating teachers. The basic paradigm was to collect a series 
of baseline observations, mee t individually with teachers to suggest 
changes which were hypotheszed to increase ALT, and then conduct a 

I 

series of follow-up observations, the ALTOS was used for observations, 
and each student-teacher pair was observed on 4 to 6 different days, for 
approximately 1 1/2 to 2 hours per visit, during both baseline' and 
follow-up periods. Twenty-five N=l experiments were conducted during 
Year 2 and 13 similar experiments were conducted during Year 3, the 
latter set of studies intended as replications. The outcomes of those 
experiments are summarized below. In the following discussion, 
■increases' means that the proportion of time the behavior was observed 
during the follow-up period was greater than that during baseline. 
'Decreases 1 means' that the proportion of time the behavior was observed 
during the follow-up period was less than that during baseline 
observations. 

It should be noted that the descriptive results from ALTOS presented 
earlier suggested that direct instruction (DI) was highly related to 
student task engagement (EN). Moreover, it was hypothesized that 
increases in EN would also be associated with decreases in student low 
task success and with increases in high task success. Task success may 
be construed as a direct observational measure of student achievement in 
the classroom. These considerations guided the following investigations 
of relationships, 
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If PI increases, th en EN increases or remains very hifi h. During Year 
2, 14 teachers increased the amount of direct instruction provided to 
mildly handicapped students in their classes. In 11 cases out o£ those 
14, the target students also evidenced increases in task engagement. 
Thus, the success rate was 11/14 or 79 percent. It should be noted that 
2 of those 11 students had baseline engagement rates in excess of 80 ' 
percent, and could not be reasonably expected to increase further (i.e., 
ceiling effects). These were the highest engagement rates observed that 
year. 

During Year 3, this relationship between DI and EN occurred in 4 out 
of 6 studies, and none of those students had baseline engagement rates 
in excess of 80 percent. Thus, this pattern replicated during Year 3 as 
well. ' 

The overall success rate for teachers" in both Years 2 and 3 was 15 

out of 20, or 75 percent.. See Table 28. 

< 

If DI dec reases, then EN decreases . We did not advise any teacher to 
decrease the amount of direct instruction provided to their MMH 
students. Nonetheless, 11 teachers did so duriA Year 3, and in 8 cases 
student engagement also decreased. This finding is very consistent with 
the above finding. That is, if teachers increase direct instruction, 
student engagement is alsoWry likely to increase; but if they decrease 
direct instruction, student Wask engagement is very likely to decrease. 
These findings indicate tha^/'there may be a causal relationship between 
direct instruction and student engagement, or that something which 
co-occurs with direct instruction is causally related to engagement. 

During Year 3 the pattern of decreased direct instruction resulting 
in decreased engagement occured in 4 out of 7 cases. 
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Table 28. EXPERIMENTAL RESULTS FROM N - 1 STUDIES IN YEARS 2 and 3* 



Type of Experiment** 



Year 2 



If Dl'.f, then ENf»(or EN remains 
above 80%) 

If DI 4*, then EN ^ 

If EN t , LO I (or LO remains 0) 

If DI t , LO I (or LO remains 0) 

If EN t, HI f 



Year 3 



11/14 (.79) 4/6 (.67) 

8/11 (.73) 4/7 (.57) 

11/12 (.92) 3/4 (.75) 

10/12 (.83) 3/4 (.75) 

7/12 (.58) 3/4 (.75) 



Overall 



15/20 (.75) 

12/18 (.67) 

14/16 (.88) 

13/16 (.81). 

10/16 (.63) 



* Ratios represent the proportion of studies in which the finding 
verified (i.e., the relation was true) 

* Key DI ■ Direct Instruction 

EN « Student Engagement 
LO = Low Task Success 
HI • High Task Success 

= Increases. 

- Decreases 
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Overall, the chances of decreased direct instruction resulting in 
decreased student engagement are 12 out of 18, or 2/3. 

If EN increases, then low task success decreases or does not occ ur. 
During Year 2 in 12 cases w<iere student engagement increased, in 11 out 
of those 12 situations, the proportion of low task success decreased or 
low task success did not occur at all, for a hit rate of 92 percent. In 
about half the cases where student engagement increased, no instances of 
low task success were observed during either baseline or follow-up 
periods. These students -were included here, since they could decrease 
low task success no further (floor effects). 

During the Year 3 replications, increases in EN were associated with 
decreases in low task success in 3 out of 4 cases. 

Overall, the chances of increased student engagement resulting in 
decreased or no low task success are almost 90 percent. 

If PI increases, then low task success decreases or does not occur . 
Given that direct instruction appears to be causally related to student 
engagement , one would expect low task success to decrease or not occur, 
since increases in engagement are also associated with the latter. This 
was borne out in the data. During Year 2, in 10 out of 12 cases where 
direct instruction increased, student low task success decreased or 
remained zero; In the remaining 2 cases where DI increased, student low 
task success rates did not change and were non -zero. 

During Year 3, the^attern between increased DI and decreased or no 
low task success was found to be true in 3 out of 4 cases. 

The overall success rate for this pattern was 13/16 or 81 percent. 
If EN increases, then high task success increases . One would hope 
that if low task success decreased, then high task success would 
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increase, although this might not happen if instead medium task success 
increased. In 7 out of 12 cases where student engagement increased, the 
proportion of time spent in activities in which high task success was 
experienced also increased. One can infer, then, for the remaining 5 
cases where EN increased, that 4 of those 5 increased the proportion of 
medium task success. 

During Year 3, increases in EN resulted in increases in high task 
success in 3 out of 4 cases. 

Overall, the success rate for this pattern is 10/16 or 63 percent. 
Summary.- The experimental findings from the 38- N=l studies conducted 
over a two-year period tend to support the general ALT hypothesis for 
MMH students. These results were consistent with earlier descriptive 
studies in which no experimental interventions were introduced. These 
findings indicate that when student task engagement' is higher, then low 
task success is likely to be lower or non-existent and that high task 
success is likely to be greater. Higher rates of daily high task success 
tend to be positively correlated with long range gains in achievement. 
Direct instruction is one variable over which teachers have some 
control. If they increase direct instruction, MMH students are likely to 
increase their engagement rates, and if teachers decrease direct 
instruction, those students engagement rates tend to drop. 

Direct instruction appears to occur with greatest frequency in 
resource room settings where class size is relatively small and teachers 
often work intensively for one to two hours per day with MMH students in 
small groups or individually. Less direct instruction of MMH students 
(either in groups or individually) tends to occur in regular classroom 
settings, and interestingly in self-contained classrooms as well. All 
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other things equal, class size seems to be a mediating factor. Given the 
general findings on the inverse relation between class size and academic 
achievement as corroborating evidence, it would appear to be 
advantageous (in terms of academic achievement) for MMH students to 
spend some time in smaller class sizes, where more direct instruction 
and individualization can occur. 
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SECTION 5 



SUMMARY OF CONCLUSIONS AND DISSEMINATION EFFORTS 
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SECTION 5 

Overall, the findings from this study tend to support the 

relationship between the achievement of mildly handicapped students 

and the amount of academic learning time provided,, ifte Results were 

generally consistent with the earlier BTES studies, which indicated 

that high rates of daily task success were positively correlated with 

long range gains in achievement. We found that when student task 

engagement is higher, low task success is likely to be lower and high 

task success is generally higher. 

General Conclusions 

Perhaps the most dramatic overall ALT finding i9 the 

«* 

relationship of direct instruction* and student engagement. Students 
were found to be 19 times more likely to be engaged than not during 
direct instruction, whereas they are only 1 1/2 times as likely. to be 
engaged than not during non-direct instruction. This pattern remains 
constant across all delivery systems* Given that teachers spend only 
about 40% of their time directly instructing a given mildly 
handicapped student or a group including him/her, this finding seems 
even more significant. 

Clearly, instruction is more individualized in the smaller 
resource and special settings than in regular classroom settings, as 
would be expected by virtue of class size alone* A relatively 

^Direct instruction means academic monitoring, feedback, 
questioning, explaining, structuring/directing and task engagement 
feedback to the target student or group which includes TS. 
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greater number of activities devoted to reading instruction occur in 
resource and special classrooms. 

Student task success, a direct observational measure of 
classroom task achievement in reading and math, did not differ much 
across the four delivery systems. Although somewhat more high task . 
success occurred in the Full-time Regular Classroom 'delivery system, 
this finding must be tempered with the fact that those students were 
the least handicapped. More importantly, in 10% of the reading/math 
activities mildly handicapped students experienced low .task success 
(almost all errors), whereas the typical "normal" student experiences 
low success less than 1% of the time. ' * 

Mildly handicapped students were observed on task about 3/4 of 

the time during reading/math activities. The large majority of 

off-task behavior occurred during independent seatwork. 

Approximately 60% of the reading/math activities occurred in seatw'ork 

settings (i.e., self-paced). 

Instructor behaviors most highly associated with minimal low 
task success were group focused academic feedback, planned 
explanations and structuring/directing. Thus, the following 
reliUonships appear to obtain: 

-When directed instruction is provided, students are 

19 times more likely to be engaged than not. 
-The likelihood of low task success is less when the 
instructor provides some group-focused academic 
feedback, planned explanation, and structuring/ 
direc ting. 

One way o£ interpreting the latter finding is that, for a typical 16 
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minute reading/math activity, when the teacher provides about 2 1/2 
minutes of group-focused feedback, explanation, and 
structuring/directing, students a-e likely to perform very well or 
medium well on the tasks. On the other hand, when less than 1 minute 
of group-focused feedback, explanation, and structuring/directing 
occurs, students are relatively more likely to perform very poorly on 
the tasks. Of course, there are other factors which probably 
influence task success to a greater extent, but these instructor 
behaviors seem to help. Perhaps the following sums it up best: 
Students do not succeed on a learning task if: 
— They do noc try. 

— They do not understand what it is they are to do 
and/or how to do it. 

— They do not know if they are doing it correctly. 
These conditions appear tp be neccessary hough not sufficient for 
task achievement. 

. Direct instruction was found to be one variable over which 
teachers have some control. In a series of 38 experimental studies, 
we found increases in direct instruction to be highly related to 
increased student engagement. For example, we found that in 75% of 
the studies where teachers increased the amount of direct 
instruction, student engagement increased. Conversely, when teachers 
inadvertently diminished the amount of direct instruction, student 
engagement decreased in 67% of the cases. These findings underscore 
the importance of this variable and influenced the development of the 
teachers guide for increasing student engagement which was developed 

r 

and field tested during year 3. 
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Overall, the findings hold a great deal of promise for special 

educators interested in developing effective classroom environments 

to maximize the probability that mildly handicapped students will 
v 

succeed academically • 
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(Complete this sheet for\ 
each teacher/classroom J 
turqut student tjoes to/ 



ALTOS IDENTIFICATION SHEET 



v. 
o 

H 

l 

O 



Observer : 



Teacher: 



Target Student: 



Class Type: 



Current Time: 



Date: CEXITD 
~ 1 



1 = Regular 3 ■ Self-Contained 

2 - Resource 4 = Other 

Class Size Today 



II)// 
ID// 
11)// 



LLJ 



□ 



C/3 
H 

W 

I 

o 



CO 



9 
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General Comments: 



CATEGORIES FOR REAL-TIME CODING OF 
TARGET STUDENT , INSTRUCTOR AND FOCUS 

1. Classification: Learner Moves (for target student, and only coded it. 

Math and Reading) 



Categories: EW. 

EO. 
EC. 
ED. 
NI. 
NW. 
NO. 



Priority Hierarchy 



Engaged - Written Response 
Engaged - Oral Response 
Engaged - Covert Response 
Engaged - With Directions About Task 
Non-Engaged - Interim 
Non-Engaged - Wait 
Non-Engaged - Off-task 

2. Classification: Instructor Moves (only coded when instructional move is 

relevant to target student in math and reading) 



1. EO, EW 

2. EC 

3. EP 

4. NI, NW, NO 



Categories: 



AM. Academic Observational Monitoring 

AF. Academic Feedback 

AQ. Academic Questioning 

XN. Explanation - Need 

XP. Explanation - Planned 

SD. Structuring/Directing 

TF. Task Engagement Feedback 

Nil. Null 

3. Classification: Focus of Instructor Move 



Prior ity H ierarchy 



1. 

2. 
3. 
4. 
5. 
6. 
7. 



XN 
XP 

AT', AO. 

AM 

SD 

TF 

NU 



Categories: TS. Target Student 

CR. Group (of which Target Student 's a member) 
NU. Null 
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his sheet for\ 
\ity-- do not J 
ansition time J 



(Complete this sheet for* 
each activii 
include transit 



ALTOS 

EDUCATIONAL ACTIVITY SHEET 



r 



H 
H 
W 



L 



H 
fa 
W 
Q 

H 

H 
w 



w 
u 

H 



TIME STARTED': [ 



Number of students engaged in same activity as TS, including TS 

1 = SELF-PACED 

2 * OTHER PACED 



TS Pacing 



Describe the major task(s) that the TS does in this activity: 



Predominant TS Activity; 
(Use more than one code, i 
if necessary) 



Task Difficulty for TS: 



1 = ORAL READING 

2 = SILENT READING 

3 = RECITING 



4 = LISTENING 1 

5 =* DISCUSSING 

6 - WRITING 



1 = EASY 



7 = OTHER 

2 * MEDIUM 



3 = HARD 



TS Instructor: 



r 1 - TEACHER 

2 = PEER (TUTOR) 

3 = AIDE (ADULT) 



4 = SELF-INSTRUCTIONAL MATERIALS 

5 = TEACHING MACHINE/TUTOR (A/V) 

6 * NO INSTRUCTOR 



Describe the major task(s) that the instructor does in this activity: 



Predominant Instructor 
Activity with TS: 
(Use more than one 
code, if necessary) 



1 = 

2 - 

3 = 



LECTURINC 

DISCUSSING 

PROMPTING 

7 = OTllKR 



4 = MODELING /DEMO 

5 =* TESTING 

6 = SUPERVISING 



□ 



□ 



□ 



□ 
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PRIMARY 



SECONDARY 



m 
m 



Content (Curriculum Subject Matter): 

Note: Use SECONDARY for coding reading/math 

only when PRIMARY is some other subject matter 

(e.g., science, social studies) that requires 
TS reading/math related tasks. 

Reading: 10. Decoding/Phonics 

11. Word Structure 

12. Word Meaning 

13. Comprehension 

14. Reading Practice 

15. Spelling 

16 . Grammar 

17. Composition/Creative Writing 

18. Reading Related - Other 

19. Reading Below Test Level 

Math: 20. Addition/Subtraction (No Regrouping) 

21. Addition/Subtraction (With Regrouping) 

22. Computational Transfer 

23. Place Value/Numerals 

24. Multiplication 

25. Division 

26. Fractions/Decimals 

27. Spatial Application 

28. Verbal Application (Word Problems) 

29. Math Related - Other 

30. Math Below Test Level 

Other Academic: 40. Physical/Biological Sciences 

41. Social Sciences 

42. Foreign Language 

Non-Academic: 50. Art 

51. Music 

52. Technological Arts 

53. Physical Education (Supervised) 

54. Perceptual Development 

55. Management /Procedural 

56. Recreation/Break 

57. Personal Experiences/Feelings 

58. Other 

Describe the content and curriculum materials used by TS in this activity: 
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Time Stopped: 



DON'T FORGET TO COMPLETE OTHER SIDE.' 



/Code only in readingA 
[math related tasks . I 



Side 1 



ALTOS 

REAL-TIME CODING SHEET 



TIME 




1. LEARNER 
MOVES 



INSTRUCTOR 
2. MOVES 3. FOCUS 
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J 



NOTES 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 
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/Code only in reading/ 
[math related tasks i 



ALTOS 

REAL-TIME CODING SHEET 



Side 2 





TIME 




1. LEARNER 
MOVES 


INSTRUCTOR 
2. MOVES 3. FOCUS 


NOTES 










i 

i 












1 
I 

4 












1 

1 — . — 












1 












1 . 












1 

4- 












1 
1 

< 












1 
1 

■ 1 












1 
1 

1 












1 

1 












1 
1 

1 — 












1 
1 
i 












1 
1 

- - i 












1 
1 
i 












1 
1 
I 


* * 










1 
1 
I 












1 

>■ 












1 
1 

■ 












1 
1 
■ 












1 
1 
• 












1 
1 
■ 












I 
1 
1 












1 
1 
1 












1 
1 
1 


4 










1 
1 


# 










1 

1 


V 











1 

1 


— — - — — 










j 
1 

= 1 












j 

1 


— — ' ' ■ 










1 
1 




\ — r 








1 

1 

j 












1 
1 












1 
1 












_ ; — | ^ 

I 

1 | 





35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 
50 
51 
52 
53 
54 

f 

55 
56 
57 
58 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 
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ALTOS Observer Reference Manual: 
Academic Learning Time Observation System 



Ted Frick Herbert J. Rieth 

/ 

s 

/ 



y"' Project ALT 

Center for Innovation in Teaching the Handicapped 

Indiana University 
Bloomington, Indiana 
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coded. 
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Introduction to ALTOS 

The Academic Learning Time Observation System (ALTOS) was designed 
to characterize how elementary level students spend their time during the 
school day. The information gained from direct classroom observation and 
coding on ALTOS will be correlated with student achievement information 
obtained before and after the period of classroom observations. 

First, we want to know the time allocated to different activities 
(e.g., language arts, math, science, recess) throughout the day. Next, 
we are interested in student and teacher engagement time during those v 
activities which include math or reading related tasks. And, most impor- 
tantly, we want to know how well students perform on those tasks. 

There are three kinds of ALTOS coding forms used: 1) ALTOS Identifi- 
cation Sheet; 2) ALTOS Educational Activity Sheet; and 3) ALTOS Real-Time 
Coding Sheet. To accurately and consistently use these forms, extensive 
observer training is required. Furthermore, observers must have adequate 
knowledge of elementary reading and mathematics content (through sixth 
grade) in order to judge the success of student performance in these areas. 
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Flowchart for ALTOS 
Coder Decision Making 



Start day 



1.1.-1.6. Complete a new ID Sheet 
for this TS* and Teacher 



1.7. Write any comments 
and staple together 
this completed 
packet. 



YES 



1. Has the teacher 
changed? 



NO 



2.3. When activity is 
over, finish the 
Educational Activity 
Sheet. ■ 



NO 



WAIT AND 
WATCH 



2. Has a new TS educational 

activity begun? NO 



YES 



2.1. Start a new Educational 
Activity Sheet. 



2.2. Does this activity involve 
any math or reading by TS? 



YES 



3. Start Real-Time Coding Sheet. 
Code clock time and behavior (s) 
using real-time categories 
by time-sampling at one- — 
minute inte^ vals. 



3.1. Has current activity ended? 



NO 



YES 



*Note: TS is the target student to be observed throughout the day. 



(Complete this sheet for\ 
each teacher/classroom J 
target student goes to J 



ALTOS IDENTIFICATION SHEET 



I 

I 



Observer j 
Teacher j 
Target Student: 

Class Type: 



1 50 Regular 

2 » Resource 



Dates I i i i i ii 



3 ■ Self-Contained 



Other 



Class Size Today 



™> CD 
id// CD 
id/' CD 



□ 

m 



General Comments: 



H 

55 



O 

u 



CATEGORIES FOR REAL-TIME CODING OF 
TARGET STUDENT, INSTRUCTOR AND FOCUS 



to 

W 
O 
SS 
M 

s 
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1. Classification: Learner Moves (for target student, and only coded in 

Math and Reading) . 



Categories: EW. 

EO. 
EC. 
ED. 
MI. 
NW. 
NO. 

2. Classification: 



Categories: 



AM. 
AF. 
AQ. 
XN. 
XP. 
SD. 
TF. 
NU. 



Engaged - Written Response 
Engaged - Oral Response 
Engaged - Covert Response 
Engaged - With Directions About Task 
Non-Engaged - Interim 
Non-Engaged - Wait 
Non-Engaged - Off-task 

Instructor Moves (only coded when instructional move is 
relevant to target student in math and reading) 



Priority Hierarchy 

1. EW, EO 

2. EC 
ED 

NI, NW, NO 



3. 
4. 



Academic Observational Monitoring 

Academic Feedback 

Academic Questioning 

Explanation - Need 

Explanation - Planned 

Structuring/Directing 

Task Engagement Feedback 

Null 



Priority Hierarchy 



1. 
2. 
3. 
4. 
5. 
6. 



XN 
XP 

AF, AQ 
AM 
SD 
NU 



3. Classification: Focus of Instructor Move 



Categories: 



TS. Target Student 

GR. Group (of which Target Student is a member) 
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ALTOS IDENTIFICATION SHEET 



1. General; The identification sheet needs to be completed once jer 
teacher/classroom change for the target student (TS) . For example, 
if TS goes to Mrs. Jones' classroom at 8:30 a.m., you would complete 
the ID sheet then. As long as TS is in Mrs. Jones' class, this sheet 
identifies to whom the other coding forms completed during that time 
refer. Suppose at 10:30 TS goes to music class (or the music teacher 
comes to TS's classroom). At this time you would staple together the 
previously completed ID sheet for Mrs. Jones and other coding forms, 
to finish that coding packet. Then you would fill out a new ID sheet 
for the music teacher. 

% mo. day yea r 
1.1. Date : Enter today's date — six digits (e.g., TTJT^J¥ 



1 « 2 « Observer Name : Write your name here and your ID// in the double box 
to the right. See master list for ID//'s. 



i- 3 * Teacher Name : Write the name of the teacher of the classroom you are 
now in and his/her ID//. See master list for assigned ID//'s. 

Target Student (TS) : The target student is the only student you 
will be observing. Write his/her name and ID//. 



1*5. Class Typ e: You should know the class type from the master list. 
Enter the class type code number in the box to the right. 

(• 

1.6. Class Size Today : Count the total number of students present, 
including TS. Enter that numbe. in the double box to the right. 

1.7. General Comments : This is to be completed when you staple the 
packet together (i.e., there is a teacher change or it is the end of 
the day) . Note anything that seemed extraordinary or unusual about 
the coding period you just finished for this packet. 

1.8. Categories for Real-Time Coding : This is for your later reference, 

if needed, when you do real-time coding of teacher and student behavior 
in reading/math related activities. This has nothing to do with the 
ID sheet , but was put here for convenient reference. 
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(Complete this sheet for\ 
each activity—do not J 
include transition time J 



ALTOS 

EDUCATIONAL ACTIVITY SHEET 



r 



H 
H 
W 



L 



H 

to 

H 
W 

< 



a: 

u 
< 

H 



g 

^ Number of students engaged in same activity as TS, including TS 
TS Pacing 



TIME STARTED: [HTTT"] 



1 * SELF-PACED (INDEPENDENT SEAT WORK) 

2 « OTHER PACED (GROUP WORK) 



Describe the major task(s) that the TS does in this activity: 



Predominant TS Activity: 
(Use more than one code, 
if necessary) 



Task Difficulty for TS: \ 1 = EASY 



{ 



1 = ORAL READING 

2 = SILENT READING 

3 = RECITATION 

7 = OTHER 



4 = LISTENING 

5 ■= DISCUSSION 

6 = WRITING 



MEDIUM 



HARD 



TS Instructor: 



{! 



TEACHER 
PEER (TUTOR) 
AIDE (ADULT) 



4 = SELF- INSTRUCTIONAL MATERIALS 

5 = TEACHING MACHINE/TUTOR (A/V) 
•6 « NO INSTRUCTOR 



Describe the major task(s) that the instructor does in this activity: 



Predominant Instructor 
Activity with TS: 
(Use more than one 
code, if necessary) 



1 = LECTURING 

2 = DISCUSSING 

3 - PROMPTING 

7 = OTHER 



A * MODELING /DEMO 

5 * TESTING 

6 - SUPERVISING 



□ 



□ 



□ 



n 



(OVER) 

r D f r DON "T ..FORGET TO COMPLETE OTHER SIDE.' 



10 



PRIMARY 
SECONDARY 



■J 

U 

OS 
OS 



Content (Curriculum Subject Matter): 

Note: Use SECONDARY for coding reading/math 
only when PRIMARY is some other subject matter 
(e.g., science, social studies) that requires 
TS reading/math related tasks. 

Reading: 10. Decoding/Phonics 

11. Word Structure 

12. Word Meaning 

13. Comprehension 

14. Reading Practice 

15. Spelling 

16. Grammar 

17. Composition/Creative Writing 
18; Reading Related - Other 

19. Reading Below Test Level 

Math: 20. Addition/Subtraction (No Regrouping) 

21. Addition/Subtraction (With Regrouping) 

22. Computational Transfer 

23. Place Value/Numerals 

24. Multiplication 

25. Division 

26. Fractions/Decimals 

27. Spatial Application 

28. Verbal Application (Word Problems) 

29. Math Related - Other 

30. Math Below Test Level 

Other Academic: 40. Physical/Biological Sciences 

41. Social Sciences 

42. Foreign Language 

Non-Academic: 50. Art 

51. Music 

52. Technological Arts 

53. Physical Education (Supervised) 

54. Perceptual Development 

55. Management /Procedural 

56. Recreation/Break 

57. Personal Experiences/Feelings 

58. Other 

Describe the curriculum materials used by TS in this activity: 



□ 



Time Stopped: 



ERIC 



DON'T FORGET TO COMPLETE OTHER SIDE J 

176 



11 



t 

ALTOS EDUCATIONAL ACTIVITY SHEET * 



• General; An educational activity is something the TS is expected to 
do by the teacher during some period of time. Usually the activity 
can be characterized by one of the curriculum content categories 
listed on the reverse side of the educational activity sheet. We 
are not interested in describing transitions between activities here, 
but describing for each activity the setting, the TS tasks, the 
instructor tasks, and the curriculum content and materials. You will 
complete this educational activity context sheet whenever the activity 
changes fo r the target student . You will know the activity changes 
whenever there is a change in one or more of thej setting, TS task, 
instructor, instructor task, or curriculum content. For example, 
there would be an activity change if TS was in a small oral reading 
group and then moved to do independent seatwork on phonics, because 
both the setting (pacing) and curriculum content changed for TS. 
Or, if. TS finished his/her phonics worksheet and then began working 
on an addition facts worksheet, there would be an activity change 
because of a change in the curriculum content. Or, if the teacher 
had been giving a demonstration at the board on how to solve fractions 
problems and then assigned similar problems in the math text for TS to 
do at his/her seat, there would be a change in the setting from 
other-paced to self-paced; in the TS task from listening to writing; 
in the instructor from teacher to no instructor; and in the instructor 
activity f ^ modeling/demo to supervising. You always judge the 
activity f r. a the point of view of TS and what is available for TS 
to attend to and do. 



2.1. Time Started ; This is the time at which the current activity for 
TS ACTUALLY begins. Time Stopped will indicate when this activity 
ACTUALLY ends. It is very important to accurately record starting 
and stoppinp, times (to the nearest minute) . This* allows us to know 
how much time was allocated for this particular activity. Do not 
include transition time here, such as getting or putting away materials 
or supplies needed for the activity, moving to a different area of 

the classroom between activities, cleaning up,, erasing board, lining 
up, etc. 

2.2. Now, the most important thing to determine is whether the current TS 
activity includes any reading or math, even though the subject matter 
may be named something else, such as social studies or science. If 

the activity does require TS to do reading or math, then you immediately 
begin real-time coding, using the Real-Time Coding Sheet, until the 
current activity is over. At that time, you will return to the Educational 
Activity Sheet and immediately record Time Stopped and the n complete ' 
all remaining items on the Educational Activity Sheet . 

If the current activity does not include any reading or math, then 
you do not use the Real-Time Coding Sheet. In this case you simply 
observe TS and other students (to disguise your focus) until the 
activity is over, and then record Time Stopped and complete all 
q remaining items. 
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2.3. 



2.4. 



jj umber of Student sJBngaged In Same Activity as TS : How many students 
in the class are currently. expected to be engaged in exactly the same 
u ! S 'SIM T f Coimt , them » deluding TS, and enter the number 

^,n 6 f I I I!™* d ° Uble h °«' F0V exam P le » lf TS is in an oral reading 
group of 8 students, enter 08. Or, if the entire class of 27 is 
doing the same math worksheet, enter 27. Or, if the teacher is 
drilling TS on sight vocabulary words with flashcards and the rest - . 
of the class is doing something else, enter 01, 

/ 

j 

TS C Pac i ln 8 ; What is .essential here is who determines the TS pacing 
of work during the Activity. If TS determines the pacing, then it 
is self-paced (cod? - 1). For example, if TS is working at his seat 
on a math worksheet, (i.e., independent seatwork) , this would be self- 
paced. Or, if TS/is working independently in the map area on his 
geography, even though several other students are also working there 
at the same time, this would be self-paced. 

On the other ly.nd, if someone or something else mostly determines the TS 
pacing, then *t is other-paced (code = 2). For example, if the teacher 
or other students are reading a story aloud in reading group, this 
would be other-paced, other examples of other-paced: teacher is 
giving a demonstration; TS is watching a movie; TS- is being drilled 
on math facts by a peer; teacher is giving a spelling test to the 
class; TS is listening to a cassette tape and following along by 
silently reading the spoken text. In other-paced activities the rate 
of TS s engagement is determined externally on a moment by moment 
basis most of the time. 

Do not code externally imposed time limits for an entire activity as 
other-paced. For example, if the teacher tells the whole class they 
have 15 minutes to individually copy their spelling words, this would 
be self-paced, since TS can do the copying independently at his own 
rate during the 15-minute period. 

Enter the pacing code in the box to the right. ' 

2.5. Describe the major tasks that TS does in this activity : In your own 
words, list the major behaviors In which TS engages in this activity. 
Be precise. For example, in oral reading: most of the time TS 
followed along in his reader while other students read aloud. He 
was asked to read two paragraphs aloud by the teacher and only made 
a few mistakes, although his reading rate was relatively slow, compared 
to others . Occasionally, he was asked by the teacher to answer a 
question about the story (comprehension questions). 

Another example, math seatwork: TS was given a math worksheet, with 
pictures of pies (or circles) with slices marked. For each written 
fraction (e.g., 3/4), he was supposed to color in the proportion of 
the pie corresponding to the fraction. He did very poorl" on this. 
He colored each slice a different color. Apparently he didn't under- 
stand the directions or he doesn't understand the basic concepts of 
fractions. 
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2.6. .Predominant TS Activity: Try to determine which of the following was 
the predominant specific TS activity: mowing was 

(1) Oral reading ; TS reads text aloud or visually follows alone 
as someone else does so. 



(2) 



Silent reading : TS reads text silently by himself /herself and 
no one else is reading that text aloud. * 



(3) ^citing : TS is required to verbally repeat or speak aloud aome- 
thing memorized as all or part of the lesson before thTTnTtr^ctor 

card' 8 ?J? Ud ' 8lV6n 3 W ° rd; Saylng answers t0 ma th flash ' 
card drill, reciting memorized poem in front of class; elves " 

fZTTf T 0 ^ 5 f ?f vocabularl y ^rds; counts aloud to 100 in 
front of teacher; recalls aloud multiplication facts (6x1 -6 
o x 2 - 12, 6 x 3 = 18...); given a word says a sentence with that 
word; given a state, names the capital; makes the phonetic sound 
when presented with consonant blends (th, sh, st, cr,...) ; recalls 
part of a story just read. In recitation there is a clearly rieht 
% or c° rrec t oral response (close-ended) expected of TS bv the 

instructor. 7 



(4) 



Listening: TS is required to listen to someone or something 
present information orally (e.g., lecture, movie, a story 
being read aloud and TS does not visually follow the text) 



(5) . Discussing : There is verbal exchange (conversation) between TS 

and others, and xt Is mostly open-ended. TS may ask questions, 
make comments, express opinions, -express pro's and con's about 
subject under consideration and/or answer open-ended questions 
(usually no right or correct answer) . If TS does not participate 
in the discussion at all but just listens, code listening not 
discussing. e 

(6) , W _ ritin £ : TS writes by print or cursive letters or writes numbers. 
Do not include drawing. E.g., copying spelling words, doing math 
w^Mnff.^ ^iting answers to problems, writing a composition, 
writing fill-in-the-blank vocabulary exercise, tracing letters 
with pencil. 



(7) Other 
e 



tlier: TS is engaged in some other activity not listed above 

free hand drawing, cut and paste, dancing, singing, playing 
soccer, etc. Specify the predominant "other" activity in the 
blank. 



What if more than one TS activity is about equally predominant'' 
Multiple codes can be used here if there is more than >ne specific 
T : S activity that occurs about equally often, e.g., TS silently 
reads workbook questions aboi t a story and writes down the answers 
in the workbook. This would be coded \l I 6| . 
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2.7. Task Difficulty for TS 

2jd d ««J U i ty 1 H 1 ,° f a l1 t38k f ° r the tar8et Student » «iz. medium or 
j£rd, must be coded for all reading and mathematics wc^T Difficulty 

tlst ftr IL ?«J? 3 m C °f ltlve demands of reading or mathematics 
task for the individual student, 

V 

wS ^P^sents work on exi sting knowledge or skills of the student . 
Time at this level may serve as useful reinforcement of existing skills. 
It includes review and practice. Few errors are made and little effort 
is required of the student. eirori 

^edium difficulty is the middle range between easy and hard, representing 
those activities that are generally challenging, for a target student" 
ln ™ lv J»8 some unacquired and some existing knowledge or skills of the 



student. 

£ard is a category consisting of tasks that t he target student cannot 
£erform beyond a chance level of correct res onses. That is, the stu 
shows essentially no understanding of the task. 



The primary basis for determining the difficulty level of a task for a 

JnTi f f eU t 13 the error rate of that stud ent for the kind of problems 
included in that task. However, in addition to error rateTthe speed 

with which a student works will sometimes be used to di f ferent late 

tne easy and medium difficulty categories. The easy, category is 
characterized by a very low error rate, where the student appears to 
be responding with virtually no errors, except what you might expect 
by chance (careless errors). The hard category is characterized by an 
extremely high error rate, where the student appears to show virtually 
no correct responses , except what you would expect by chance (luck) . The 
medium category includes the range between easy and hard . The additional 
consideration of the speed with whi ch the student works through the 
problems enters in when virtually no errors are observed, but the student 
is working at a noticeably slower than average pace. If 'such an unusuaUy 

JZ2 t ^u 8 8 r SP ° nSe rate 13 n0t Sim ^y a functl °" of a l ow level ' 
of engagement, but in fact appears to be the result of the difficulty 

of the task for that student, then medium would be coded rather than easy . 

The observer should take into account the speed with which the student 

completes a task only when the student is obviously muc h slower than 

the average student in that classroom working on that task. For example, 

I t in *S h3S Spent 30 mlnUtes on tht ' flrst th r e e problems 

of a 20 problem computation worksheet, while most of the class completed 
the entire worksheet in less than 30 minutes, then medium would be coded 
even if the target student has answered those first three problems with 
no errors. K 1 Witn 

Difficulty level is not coded on a problem-by-problem basis. All of the 
MQbJems y thin the related set receive the same difH.„lM, ^h^TT^^ 
to the student's performance on the set as a whole. 

lLl h Zltrll n0t tt that i . di f flc » lt J ls a^ys coded for the academic task 

In ? 6 ? ?° T * f0t 3 8lVen eVent ' Therefore, when the 

^tudent is listening to the teacher give directions or task engagem ent 
ie^back the coding of difficulty does not , relate "to t hose dictions " or 

FR?r 1 - n taL ^ Gd M C h T !?' R f h€r ' Lt relateS t0 the content of the ac * d emic 
yStL IbO taSk t0 whlch tne Sections or task engagement feedback apply. 
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Accurate coding of difficulty level will obviously be, itself an 
extremely difficult task in some cases. Nevertheless, the difficulty 
level of reading and mathematics content must always be coded, even 
when the student was not engaged in the task for which difficulty is 
coded. Where little information is available for the determination of 
difficulty level, the observer must make his/her best judgment at the 

The judgement of difficulty level must be made on the basis of overt 

responses by the tar get student in relationship to the task undlr 

observation . Therefore, the coding of difficulty will be less reliable 
when few or no overt responses are observable. However, it will be * 
possible to isolate, for the purposes of data analysis, those events 
for which there may have been few or no observable overt responses. 
These events will be characterized by the learner moves coded with them,* 
indicating that the student's engaged response was covert or that the 
student was not engaged. Therefore, it will be possible to analyze 
the extent to which the availability of overt student responses is " 
related to the reliability with which difficulty level can be coded. 

It should be noted, however, that the observer can often judge difficulty 
on the basis of overt responses even when no overt response occurs within 
the particular activity being coded. Previously observed overt responses 
for the same kind of problems can be used to determine difficulty. In 
addition, the observer can simply ask the target student to perform a 
problem overtly (read aloud, compute a mathematics problem, etc.). Often 
it is possible to ask a student to do a problem during the ongoing 
observation. In other cases, the observer may prefer to wait until a 
recess or lunch period, ask the student to perform a problem, and 
retrospectively code the difficulty level for previous activity. 

Several specific situations warrant consideration to clarify the ap- 
plication of the procedures described above. First of all, the error 
rate used to judge difficulty must be evaluated in terms of the probability 
that a student can guess the answer to a problem without understanding it. 
This will depend a great deal upon the kind of problem performed by the 
student. For example, if the student is writing complete sentence 
answers to reading comprehension questions, then there is very little 
possibility of his/her correctly guessing the answer. However, if the 
student is responding to true-false questions for reading comprehension, 
then there is a fifty percent probability of his/her correctly guessing 
the answer. 

Error rates and the probability of guessing correctly are not as readily 
applicable to oral reading as they are to other activities. This is 
because there are many opportunities for errors, and little apparent ' 
chance for guessing (decoding and comprehension skills would have to be 
applied in order to guess). Furthermore, the passage to be read may be 
a combination of extremely easy and extremely difficult words. For the 
purpose of enhancing the reliability of coding between observers, a 
simple rule will be used here. If the student is unable to read onlv 



*Learner moves are coded on the Ri j al-Tlme Coding Sheet. 
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one word (or none) per paragraph , then the passage will be coded as 
■ eas y. for that student. If the student is generally unable to read at 
least two but no more than eighty percent of the words in each paragraph, 
the the passage will be coded as medium for that student. If the 
student is unable to read more than eighty percent of the words per 
paragraph, then the passage will be coded as hard for that student. 
"Unable to read" would apply to words that the student cannot read 
properly without prompting. This should not include careless errors. 
If it appears that a student has misread a word only because of a care- 
less error, then that error should not be included in the determination 
of error rate. 

The context within which problems are performed may affect the error 
rate for those problems. For example, a given student might be able to 
perform certain computation problems with virtually no errors when 
working alone at his/her seat. The same student, however, might be so 
distracted when working at the board in the front of the class that 
he/she shows a high error rate, possibly even being unable to answer 
the problems at all. Those problems for that student would therefore 
be coded at different .difficulty levels depending upon whether the 
student is working at his seat or at the board. Hence, the context 
within which the problems are performed is considered to be pa,rt of 
the problems themselves, for the purpose of coding difficulty. 

2.8. TS Instructor; - Who or what is doing the instructing (providing 
information, soliciting TS responses, giving feedback)? 

(1) Teacher ; The person formally in charge of the classroom is 
instructing TS. 

(2) Peer (tutor> ?'' Another student is instructing TS. 

(3) Aide (adult) ; Some adult person other than the teacher is 
instructing TS (e.g., st .-lent teacher, parent volunteer). 

(4) Self-instructional mate i: , >.*>; The information and feedback are 
part of the materials for instructing TS — e.g. , special workbooks 
where the correct answer shows a special color when marked; a 
non-branching filmstrip with cassette audiotape which solicits 

TS responses and provides feedback; an instructional game 
(excluding teacher participation); a puzzle, where the feedback 
comes from finding the correct solution. The materials themselves 
are non-adaptive to TS responses, but do provide feedback to TS 
responses. 

(5) Teaching Machine/Tutor ; The information and feedback are presented 
through a mechanism which is adaptive to the TS— e.g., an 
interactive computer program which presents information and 

gives feedback depending on how TS responds to task; a simulation/ 
game on a computer where computer adapts/competes with TS based 
on his/her responses. 
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(6) No instructor; All of the above means of instruction include a way 
to monitor directly how well the TS is doing at the time the TS 
is engaged in the activity and have the capacity to provide feed- 
back or correction immediately, (during the activity). If this 
condition is not met, then the*re is no instructor, e.g., TS is 
doing a worksheet independently and does not get any immediate 
feedback during the task; TS is silently reading and answering 
questions in a workbook and cannot tell for sure whether his 
answers are correct. . 

2 ' 9 ' Describe t he major ■ task(s) tha t the instructor does with TS in this 4 
activity: In your qwn words list the major behaviors in which the 
teacher engages with the TS during this activity. Be specific. For 
example, in an oral reading lesson: Instructor calls on children to 
read in a random manner (TS never knows when will be called on), lets 
TS try to correct own mistakes first, and if necessary gives hints 
instead of telling TS the correct word; only tells correct word if 
TS has tried and failed several times. About every 2-3 paragraphs, 
instructor asks a question to the whole group about what was just 
read, and calls on TS twice. Another example, i^math seatwork: 
T. passes our worksheet, gives directions, demonstrates to group how to 
do the first two problems, and then works at desk generally supervising 
the seatwork. At least 5 times TS brings worksheet to T's desk for 
hel,i and T probes and prompts TS on the part TS was stuck on. 

i 

Note: There is no need to describe T. tasks with children other than 
TS, unless the T. behaviors are directed to the students in the 
group o,f which TS is a member. 

* 

2 ' 10, ^dominant Instructor Activity with ts ? T ry to determine which of the 
following was the predominant specific instructor activity with the TS 
Do not be concerned with teacher activities with students other than 
TS, unless they are directed to the group of which TS is a member 

(1) Lecturing : This includes telling, explaining, informing, reviewing 
. reading to TS about something, etc. TS is primarily exacted to 
listen. Do not code lecturing if instructor is demonstrating or 

• ES ! would 10 ? t0 * 0 il BOneth * n ? and . ls explaining during the demonstration. 
This would be coded as modeling /demonstration (see below). 



(2) 



(3) 



Discussing : iere is verbal interchange between instructor and 
TS (or group deluding TS); it is mostly open-ended (usually 
no right or wrong answers). Instructor may ask questions/make 
comments, express opinions, express pro-! 8 and con's about suhiect 
under consideration, and/or answer questions asked. \ 

Promptin g: The instructor asks questions, solicits TS responses 
gives hints/cues and/or reminders, gives feedback/correctives/ ' 
reinforcement to TS when there is a clearly right or correct' TS 
response expected. Instructor may also give a brief explanation 
or demonstration based on TS difficulties in responding, e g • 
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- T gives spelling word, calls on random student, 
listens to him/her spell, gives hint if not correct, 
acknowledges correct spelling; 

- T watches TS do a fractions problem at board, asks 
him what he is doing at each step, corrects if neces- 
sary; 

- Vocabulary drill— instructor shows card, TS says 
word, instructor indicates if right or wrong, or 
tells word if TS is stuck; 

- Oral reading— instructor listens to TS read, prompts 
if TS makes a mistake or is stuck, encourages TS to 
read (positive reinforcement), asks comprehension 
questions occasionally. 

(4) Modeling/D emonstrating ; The instructor shows TS (or group of TS) 
how to do something. Usually this is planned ahead of time (i.e., 
not based on immediate questions or difficulties S may be having 
with task), e.g.: 

- T at blackboard and shows how to do long division 
problen, how to diagram sentence; 

- T shows how to cut out a snowflake; 

- Movie narration and pictures show how to safely 
handle chemicals and what happens if careless; 

- T performs a science experiment on Boyle's law for 
S's 'to watch. 

- T takes a turn reading aloud during oral reading. 

(5) T¥^ ! q' InStrUCt ° r V 0CTnally asses smg TS (or group with 
TS) and S s are aware that it is a test and that some kind of 
a score rating, or grade will be assigned based on each ' 
S's performance. 

#(6) Supervising : The instructor Is not directly interacting 
with or instructing TS (or the group with TS),, but is 
instead overseeing student task engagement. The instructor 
does not communicate directly with S's most of the time 
although may occasionally answer questions or make comments 
about student work, e.g.: 

T sitting at desk, grading papers and watching 
class; 0 

- T walks around class and looks at students' 
• work to see how its going, occasionally making 
.remarks to some students. 
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(7) Other ; The instructor is engaged in some activity not described 
above. Specify examples in the blank. Examples: 

- T is out of room during current activity; 

- T spends most of time on discipline (behavior 
management) problems during current activity. 

Note: II two or more specific teaching activities occur about equally 

during the tiihe period, then enter multiple c odes — e.g. , modeling 
and prompting and supervising would be coded: j A 1 3 | 6 | • 
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,2.11. Reading Content Categories Summan 



Category // Category Name 
10. DECODING/PHONICS 



-single consonants 

-consonant blends and digraphs 

-variant consonants (c or g) 

-short vowels 

-long vowels 

-other decoding 



EXAMPLES 



11. 



WORD STRUCTURE 

-compound words 

-root words and affixes 

-syllables .. 



12. 



WORD MEANING 
-synonyms 

-pronoun reference 
-other word meaning 



13. 



COMPREHENSION 

-verbatim (no rephrasing) 
-translation (paraphras'e) 
-inference/synthesis 
-identifying main ideas 
-evaluation of fact and opinion 
-other comprehension 



14. 



READING PRACTICE 



-sight words (general practice at reading single words) 
-oral reading of text 



-silent reading of text 
-reading in content areas 
-listening while reading 



15. 



READING RELATED - SPELLING 



16. 



READING RELATED - GRAMMAR 
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READING RELATED - COMPOSITION/CREATIVE WRITING 
READING RELATED - OTHER 
READING BELOW TEST LEVEL 
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Reading Content Category 
Definitions , 



10. DECODING/PHONICS - learning letter-sound correspond 



ences 



A number of different tasks can be used in exercises aimed at teaching 
decoding; for example: 

a. The child could be asked to giv6 the Sound associated with 
a particular letter or group of letters. 

b. The child could be asked to read words with a common sound 
or with a rhyming pattern, 

c. The child could be asked to recognize or identify a word 
containing a particular sound. 

d. The child could be asked to write words with a particular 
sound. (Spelling or dictation are decoding tasks when they 
focus on a particular spelling pattern.) 

e. The child could be asked to match words containing the same 
sound . 

f. The child could be asked to locate all the words in a list 
or story which have a particular sound or spelling pattern. 

g. Even fill-in-the blank exercise can be decoding, if the choice 
the student must make deppnds on and teaches accurate decoding. 

For example: 

Mary put the around the package. 

sting 
bring 
string 

What these tasks (and others not listed) have in common is that they 
pair particular letters or groups of letters with particular sounds 
and they teach students to make the association. 

Note : Sometimes, particularly in some basal reader programs, students 
will read single words where the lesson does not focus on a par- 
ticular spelling-sound correspondence. This would be coded as 
reading practice (//14)-- sight words. See that category for 
further discussion. 
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10.1. Single Consonants 

Single consonants located in any position in' a syllable or word. 
Examples: /t/ in tan, bat, ate 

10 . 2 . Consonant Blends and Digraphs 

Common combinations of consonants, located in any position in a 
syllable or word. 

Examples: Blends include st, tr, fl, cr, sp, spr, thr, nd, etc. 
as in flower, spread, sand 

Digraphs include sh* ch, th, wh as in where, .thin, wash. 

10.3. Variant Consonants (c or g) 

Most^ consonants have one dominant letter-sound correspondence. Some 
consonants are variable; they have 2 common patterns. 

Examples: cat vs. city; £pat vs. gentle 

Tasks: To fall in this category, teaching tasks should compare and 
contrast the two decodings of the same letter. The student 
might have to decide which sound was appropriate in a 
particular word,* or with a particular vowel following 
the consonant y(ca vs. ci). 

/ 

/ 

10.4. Short Vowels J 

/ 

Regular short vowjsl sounds of a, e, i, o, u. 
Examples: bat, red, sick, pond, fun 

10.5. Long Vowels 

Regular long vowel sounds of a, e, i, o, u. 

Two major types of spelling patterns produce these sounds - final 
e and digraphs. 

Examples : bake ; rain 

these; mean, feet 
fine 

pole; boat 
huge 
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10.6. Other Decoding 

Besides the basic categories above, other specific decoding patterns 
might be taught. 

Examples: Complex vowel combinations such as dipthongs (oi, ou, oo, 
aw, etc.) 

Sounds of "y" as a vowel (as in cry, candy) 

Effects of consonant context on vowel decoding (vowels 

followed by "r" as in cart or fair; vowels followed by 

"1", as in tall) 

Silent consonants (know, ghost) 

Etc. . 

11.0 WORD STRUCTURE — analysis and meaning of word parts 

11 • 1 Compound Words 

Two meaningful words are combined to form a new word, which takes 
its meaning from the parts. 

Examples: mailbox, goldfish 

Tasks: Students might be asked to identify the parts, combine parts 
to create new words, or identify words which are compounds. 

11.2 Root Words and A ffixes 

Prefixes and/or suffixes added to a root word 

Examples: suffixes like -ly, -ful, -less, -able, -er, -est, -tion, etc. 

prefixes like un-, re-, mis-, trans-, pre-, ex-, in-, etc. 

grammatical endings like -s, -ed, -ing 

(Includes spelling changes like doubling the consonant, 
dropping the final e, or changing y to i. Also includes 
irregular forms like go, goes, went, gone, going.) 

Tasks: Students might have to identify root words, identify affixes 
in words, or add affixes to words. Includes work on the 
meaning of affixes and on the correct use of word forms in 
sentences (John is . up the street.) 

walk 

walked 

walking 

The student might have to decide which prefix or suffix was 
needed to create a particular meaning, or the student might 
have to figure out the meaning of a word from the meaning 
of the parts* 
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' 11.3. Syllables 

Conventional or sound-based units rather than meaningful units. 

Examples: demonstration - dem on stra' tion (4 syllables) 

Tasks: Students might ^iave to identify the first or last syllable 
in a. word, or break a word into syllables, or determine 
the. number of syllables in a word. Included work on locating 
the accent or stress in a word. 

t 

■ » 
12 - 0 ' WORD MEANING ~ Understanding the meaning of a specific 

word or phrase 

12.1. Synonyms 

Two words which mean about the same thing. 

Examples: vibrating ship = shaking ship 

discover a cave = find a cave 

little = small 

everyone » all 

Tasks: Students might be asked to name a word that means the same 
thing as another word. Or students might be asked to match 
words that are synonyms. 

12 , 1 Pronoun reference 

The meaning of a pronoun 1 conies from the noun to which it refers. 

Examples: Lisa tried to open the window. 
It was stuck. 

(What does "it" mean? window ) 

Tasks: The student might be asked ,to identify the noun a pronoun 

refers to (as above). Or the student might be asked to fill 
in the appropriate pronoun for an incomplete sentence. 

(John handed 7 the teacher ; homework paper*) 

her 
his 
its 

12.3. Other word meaning 

Meanings of words alone or in the context of a sentence 

Examples: Definitions, including using dictionary entries to 
define words 

Definins words from context (using the meaning of a 
• sentence to figuro out the meaning of an unfamiliar 
word or a word with multiple meanings) 
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John used the term "habeas corpus 11 in his speech 
about law. 

term means 

A. a period of time 

B. an assigned time to serve 

C. a word with an exact meaning 

D. a condition or requirement 

Using words in sentences (writing a sentence that shows 
the meaning of a new vocabulary word) 

Antonyms (words opposite in meaning) 

Figurative Language (recognizing the meaning of a 
word or phrase used in a nonliteral sense, including 
simile, metaphor, and idiomatic expressions) 

"John laughed; his head off." 
means "John laughed a lot." 

Crossword Puzzles 

•> 

Classification of words (apples, oranges, and peaches 
are fruit) . 

Tasks: The student might be asked to give the meaning of a word, 

match a word with its definition, or write a sentence using 
a particular word. 

13.0 COMPREHENSION - Understanding of ideas expressed in written 

material, including understanding of literature 
and understanding of written material In the 
content areas (science and social studies) 

The story below will be referred to in the examples of the comprehension 
categories. Time spent reading the story would be coded in Reading 
Practice. Time spent answering questions, writing about, or discussing 
the story would be coded in Comprehension. 

SAVING THE SEALS 

Who owns the sea? The ships of all countries sail the open 
seas. Not long ago, all countries could fish and hunt in the 
ocean as they pleased. Now, the countries using the sea must work 
together to protect the sea's animal life. 

In 1870, there were millions of valuable fur seals in the 
Bering Sea. Ships came from all parts of the world to kill them. 
Men waited the animals' fur and the oil from their bodies. By 
1910, only about 130,000 seals were left. Even the hunters knew 
that something had to be done or the seals would disappear. 
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Four countries owned land near the seals 9 northern home. 
In 1911, these countries began plans to control seal-hunting. The 
governments of Japan, Russia, Canada, and the United States agreed 
to kill no more seals in the open seas. Because ttcy wanted to 
protect mother seals and their young, they agreed that only male 
seals without mates could be killed. Money earned from the skins 
and oil of these seals was to be divided among the four governments. 

Today, large heards of seals swim in the Bering Sea again. By 
working together, four countries saved the seals in the sea they 
share. 

13.1. Verbatim (no rephrasing) 

Understanding and recall of information exactly as stated in the 
text. 

Examples: 1. Where do large herds of seals swim today? (in 
the Bering Sea) 

2. Which governments agreed to kill no more seals 
in the open sea? (Japan, Russia, Canada, U.S.) 

3. Why did they agree that only male seals without 
mates could be killed? (to protect mother seals 

— and their young) 

13.2 Translation (paraphrase) ^ ' - 

Recognizing ideas stated in different words; recall of information _ 
when ideas are restated; rephrasing of ideas in other words. 

Examples: 1. Which countries joined in the agreement to limit " 
seal killing? (Japan, Russia, Canada, U.S.) 
2. Describe in your own words what the countries 
agreed to do. 



13 . 3 Inference/Synthesis 

Synthesis of information from different points in a text; under- 
standing of ideas implied by a text; using background knowledge or 
experience to interpret or extend the ideas in a text; drawing 
conclusions or predicting outcomes. 

Examples: 1. Why were the seals hunted? 

a. People wanted to eat seal meat. 

b. Their fur and oil were valuable. 

c. The seals were eating all the fish. 

2. The story does not say so, but it makes you think 
that 

a. hunters used seal oil on their bodies 

b. seals have little value for hunters 

c. all the seals might h ive been killed 

3. What would happen if only 2 of the 4 countries 
Pj£ joined the agreement? Jfjrj 
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13.4 Identifying main ideas 

STSlEii "I** ° f 3 PaSS38eJ identlf yi"8 and understanding 
the central or most important ideas being communicated. 

Examples: 1. On the whole, this story is about 

a. Russia and Canada 

b. protecting seals 

c. hunting in the Bering Sea 

What message is the author trying to get across? 
(It is important to. protect animals. Countries 
need to work together.) 



2. 



Besides answering questions, this content category 
includes work on outlining a passage, or recognizing 
the structure and organization of a passage (super- 
ordinate and subordinate elements). 

V 

13.5 Evaluation of fact and opinion 

Critical analysis of statements and the basis for their acceptance: 
identifying fact and opinion statements. Also includes evaluation, 
of the qualifications of a speaker/writer and understanding how 
loaded" words convey opinions. 

Examples: Which statement is a fact rather than an opinion? 

a. Seals should be protected. 

b. All the seals very nearly died. 

■ — c - In 1910, only about 130,000 seals were left. 

13.6 Other comprehension . ^ 

Comprehension of written material which does not fit one of the 
specific categories above. Also includes situations where a 
comprehension activity mixes several types of comprehension so 
thoroughly that it would be impossible to separate the time. 

Examples: Following directions 

Application of reading skills to real-world 
materials like signs, menus, TV schedules, 
etc. 



14.0. READING PRACTICE - Practice in reading 

Note: All reading activities involve the act of reading. Use the 
• Reading Practice category onl^ for activities where students 
spend time just reading. We will automatically assume that 
time in specific skills (decoding, word structure, word 
meaning, or comprehension) includes some reading practice 
as well. 
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14.1. Sight words 

General practice at reading single words. No particular decoding 
focus* Students must integrate a variety of decoding skills in 
order to read a word on sight. 

✓ 

Tasks: Students read these words at the beginning of a lesson: 
slippers bought hurry etc. 
Teacher reads a word and the students must circle it: 




Any word reading task where there is no intent to practice 
specific decoding patterns. 

14. 2. Oral reading of text 

Individual or choral reading of * stories by students. 

Tasks: Reading circle where students take turns reading aloud 
from a story. 

14. 3. Silent reading of text 

The student reads a story to himself. 

Tasks: Students have time for independent reading. Each student 
reads to himself. Students might go to the library and 
read. A student might read when he finishes other work 
early. 

14.4. Reading in content area s 

^Reading science or social studies material (oral or silent) 

Tasks: The student reads "silently in^the social studies book. 

The students take turns reading aloii^ fronv- the Weekly 
Reader. ^ 

14.5. Listening; while reading 

The student listens while he roads in an accompanying text. 

Tasks: The student must be simultaneously reading and listening. 

He could be listening to a tape or record of a story and 
reading along. Includes music if the student is both 
reading and singing. 
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READING RELATED — SPELLING — matching word sounds with 

particular configurations of letters 

Tasks; The teacher might read a word or sentence and have the 

students write it. Students might have to decide whether 
or not a word is spelled correctly. Includes work on 
homonyms (like "to", "too", "two", or "peace", "piece") 
and their correct use in sentences. Some lessons may focus 
on particular patterns in letter-sound correspondence 
(like sounds of the letter "y", or words with silent "e"). 



16.0. READING RELATED — GRAMMAR — understai ding sentence structure 

and grammatical form. 

Examples: Capitalization, punctuation, parts of speech, diagramming 
sentences 

Tasks: Many possible activities involving grammatical concepts. 

17.0. READING RELATED — CREATIVE WRITING — students make up their 

own stories and write them. 

Tasks: The teacher might have all students write a story about summer 
vacation. Or students might write their own endings to a 
story they have been reading. 

18.0. READING RELATED — OTHER 



18.1. Study skills 

Learning and using skills that help the student acquire knowledge 
through reading. 

Examples: Dictionary skills, alphabetization, table of contents, 
using the index, using the encyclopedia, card catalog, finding 
books in the library. 

18.2. Other 

Other activities which are related to reading. 

Examples r fWeign language . 

Reading maps or graphs. — 
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19.0. READING BELOW TEST LEVEL — copying or imitating 



Examples: Copying, where the student directly copies letters, 
words or sentences. Includes penmanship. 
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CONTEXT CLUES — A COMMON FORMAT 



A common response format in workbook pages, especially in earlier 

VtlLrl 2 ? h \ Student t0 Mil in the blank *> complete a sentence. 
To perform the task the student must read the senterice parts that are 
given and understand their meaning in order to recognize the element that 
would complete the thought. He must use the context as a set of clues 
which define the nature of the missing piece. Understanding the sentence 
framework is a comprehension process. But the task also involves selecting 
the best word(s) to fill the blank, and the nature of the choices is 
tils* 1 ' T ° code the c ontent of ite m s in a context clues format, consider 

the distinctions the ch ild must make in order to s elect fhJT^^7 

alternative . 7- ' — 

The examples below show some of the different ways a context 
clues format can be used: 

Decoding : 

Jane ate a red candy 



cane/can 



Here the student must not only understand the sentence but 
also know the role of final e in decoding vowels. Without 
this knowledge of decoding patterns, the child might know the 
word he wants to fill the blank but still select the wrong 
alternative. The purpose of the exercise is to practice 
decoding rules. 

Word Structur e : 

Tim went down the street 

skip 

skips 

skipping 

This exercise teaches correct use of grammatical endings. 
Word Meaning : 

Susan ran to her house. Then went inside. 

she 

he 

it 

This requires pronoun reference. 

Some animals have snouts. They are really long 



ears 
mouths 

noses 



9 



34 



Because the ocean roars, we need to to be heard, 

talk 

shout 

whisper 

In the two examples above, the emphasis is on the meaning of the missing 
word. The student must consider the semantic distinctions among the choices 
in order to select the word with the best meaning to complete the sentence. 

Choose from these words to complete the sentence below: 

lazy dozing buzzed dizzy grazing 

Soon, a bee around the colt's head. 

'A 

In this example the word choices all have the letter "z". But this 
decoding element is a constant factor; students don't have to focus on the 
decoding in order to complete the sentence. Sentence completion focuses 
on selecting the word /ith the best meaning, (Note: Time spent reading 
the word choices and talking about the sound of the letter "z" in these 
words would be coded as Decoding. 



Comprehension : 

After reading the story of the Little Red Hen, the student must 
complete this sentence: 

The fox lived in a house made of . 

straw 
wood j 
stones 

o 

The purpose of questions like this is to check story comprehension; the 
correct answer depends on having read the story. This question assesses 
understanding of event data (verbatim) . 
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20. ADDITION/SUBTRACTION (NO REGROUPING) 

- standard short form 

- basic facts 

- speed tests 

21. .ADDITION/SUBTRACTION (WITH REGROUPING) 

, - standard short form 

- basic facts 

- speed tests 

22. COMPUTATIONAL TRANSFER (Properties, # patterns, missing addend 

number sentences with inequalities) 

23. PLACE VALUE/NUMERALS (whole numbers) 

24. MULTIPLICATION 

- basic facts 

- speed test 

- multiplication algorithm 

25. DIVISION 

- basic facts 
".speed test 

- division "algorithm 

26. FRACTIONS /DECIMALS 

27. SPATIAL APPLICATION 

- linear measurement 

- geometry (perimeter, area, // pairs, lines/figures) 

28. VERBAL APPLICATION 

- word problems 

29. MATH RELATED 

30. MATH BELOW TEST LEVEL 

zoo 
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Math Content Category Definitions ' 



20. ADDITION/SUBTRACTION— NO REGROUPING 

i 

Learning the basic addition and subtraction facts. Finding the sum 

or difference of problems which do not require the renaming of 10 

ones as 1 ten or 1 ten as 10 ones (i.e., no "carrying 11 or "borrowing"). 

20.1 Basic facts: Basic addition facts are the sums of two single digit 
addends up through 9+9. The bapic subtraction facts are the 
• inverses of the addition facts and therefore include facts up through 
18-9. 



( 

.1 d 



20.2 Non-regrouping problems in addition: Sums of a single digit and a 
multiple digit addend or two or more multiple digit adjdjgnds which 
do not require the renaming of 10 ones as 1 ten. 

10 23 547 

+ 5 + 46 + 201 

Includes column addition without regrouping. 

6 20 21 

4 30 13 

+ 5 +10 +15 



20.3 Non-regrouping problmes in subtraction: Finding the difference 

*between a single digit and a multiple digit number or the difference 
between two multiple digit numbers which do not require the renaming 
o^ 1 ten as 10 ones. 

27 28 532 

- 7 - 14 - 420 

Note: Problems in this category can be presented in a variety of 
formats. 



The problem may be laid out horizontally or vertically: 

2 3 
+ 3 -2 2 + 3= 3-2 = 
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Pictoral representation may be used to help the students understand 

t pr0c ? 88 ; 8 0f J° inin 8 or separating sets and/or as an aid 

in carrying out the computation involved. 




0 12 3 4 5 



2 + 3 



3 - 2 



In all of the examples above, the primary task is to find the sum or 

tll Tu* K?^ 66 " tW ° numberS When both of those nu-ber. a „ as 
the applicable operational sign are given. 

However, there are situations where instructional algorithms or 
processes involving place value concepts are used in the teaching 
of these same computational skills ana when this occurs the instruction 
should be coded under category #23. instruction 

» 

There are other situations which require more than the straight- 
forward computation of a sum of difference (but do not involve place 

Section"* 22T SitUati ° nS dlSCUSSed in ?ransfer 



ADDITION/SUBTRACTION — REGROUPING 

Addition problems which require the renaming of 10 ones as 1 ten ("carrvin^ 

?»borr 0 „r^° n S r ° blemS Whi0h reqUire the renamin * of 1 as 10 ones" * ' 
( borrowing"). Here we want to include only the regrouping problems which 

are presented in the standard computational algoritLc fo^ma" aUo 
known as the short form. 



27 + 3 = 




13 
15 
± 16 

44- 



26 
■__9 

17 



40 
- 15 

25 



This category is parallel to category 20 in that the student is given 
two numbers and told to find their sum or difference but in this case 
the problems also require regrouping. The general guidelines on format 
in category # 20 also apply to this category. 



COMPUTATIONAL TRANSFER 

Tasks which require the student to recognize and apply some of the 
operational concepts and patterns within our number system. The 

bu^in^n^^rrf ^ the T"' 10 " 5 Whlch Underlie computation, 
Includes* involves more than straight-forward computation. 

202 
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22.1 Properties : -\ ( 

r. Commutative property of addition and multiplication! 

3+2*2+3 
2x3-3x2" 

0 

2. Associative (.grouping) property of addition. 

2 + (3+5) = (2+3) + 5 

3. Properties of -zero. , 
Identity element of addition: 18 + 0,= 18 

4. Distributive property. 

2 x (3+2) = (2x3). + (2x2) 
jy * (12+6) t 3 = (12*3) + (6*3) 



22.2 -Number Patterns ; Tasks which promote the student's search for and 

recognition of the various patterns which can be' found among numbers. 

Examples^ • 

1. Counting by 2 r s (odd and even numbers). 

2. Counting by 5 f s, 10's, 20 f s, etc. 

3. Functions - discovering or applying a function rule like add 3, 
subtract 2, etc. 1 

a. Rule is given: Add 4 to each number in top row: 



10 

b. Student must discover and apply the rule/ to complete the pattern, 



1 


3 


8 


4 


4 


6 


11 


? 



7, 5, 3, ? 

I 

{ (1,2), (2,4), (3,6), (4,?) } 
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22.3 Missing Addends - Open Sentences: Number sentences in which the 
sum or difference is given and one of the addends or numbers is 
unknown. 



Examples: 



□ - 5 » 5 

□ A 
+ 3 +□ ^ 5 -□- 2 

7 . 7 



7 □ + 6 - 10 

Jrj -□ a +□=10 

• 4 V 

22 '* ' Number Sen tences with Equalities and Inequalities - Includes only 
th.ose number sentences that involve computation plus the use of 
>.<»-,+,-. * ' 

7-601 + 3- ' J A 2 -'3 

* • T © 4 - 3 * . 

10 -10 © 15 + .5 . - 8 A 3 . ■ 11 

# 

» 

This category does not', include the use of inequality signs in numerical 
. . comparisons, i.e., 

27© 26 



127 ©126 



This should be coded as #23 (place value/numerals) 



22.5 Factors and Multiples: The study of common and least common multiples, 
common factors, sets of factors, prime numbers, and prime factorization. 

J 

Examples: 

1. 6 xQ- 45 • . 2. 12 = 2 x 2 x 3 

3. Name the multiples of 2, less than 20* 



c 
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23. PLACE VALUE /NUMERALS 



23 «1 Place Value/Numerals - Place value involves the concept that a digit 
has three meanings'. It's face value (the meaning it has wherever it 
is used), it's plaze value (the meaning it takes from it's place in 
a numeral), and it's total value (which is the product of the first 
two values). In the numeral 45, the 4 has a face value of four, a 
place value of ten, and a total value of forty. Teaching place value 
will involve expanded and compact notation, identification of the 
one's, ten's, or hundred's place, and naming the number of tens (or 
ones, etc.) in a numeral. 

t n 

Numerals includes understanding the order of the counting numbers and 
evaluating the sequential position of one numeral in relation to 
another. Comparing and evaluating numerals will involve place value 
concepts. 

Examples : 

A. Place Value: 



1, 
2, 
3, 
4, 
5. 



How many tens in 75? 
Which number is in the one's place? 
6 tens and 2 ones = 60 + 2 ■ 62 
155 - 100 +>50 +5 

Use of manipulatives or pictures to teach numerical structures 





I 



2 hundreds, 



3 . tens, and * 



We write 234 



B. Numerals 



1. Writing the missing numerals. 

1 I 49 I 1 V 



46 



2. 
3. 
4. 
5. 



What number comes before, after, or between? 

Using inequalities: 145 > 135. 

Practice in reading numerals up through millions. 

Understanding the use of commas to set off the periods (e.c., 

1,575,231). 
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23,2 Addition/S ubtraction With or Without Regrouping - Instru ctional 
Algorithms With Place Value Transformations! 

In our base 10 number system the understanding of place value is 
essential to the learning of computational skills. With this in mind 
curriculum materials often include instructional algorithms or processes 
which combine place value concepts along with practice in computation. 
These processes mav involve expanded notation or the designation of 
tens and ones. Some common (depending on text) instructional algorithms 
are: 

14 = 10 + 4 , 
+ 14 a iQ+4 (Use of Expanded Notation) 

20 + 8 = 28 



Tens Ones 

+ 14 =i 4 (Designation of ten's and one's place) 



14 
+ 14 



.8 (Long form with partial addends) 

20 
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24. MULTIPLICATION 



24.1 Multip li cation - Basic Facts ; Multiplication with two 1-digit factors. 
Also known as times table up through 9x9 . 

2 *' 2 Multiplic ation - Speed Tests ; Timed tests in the basic multiplication 
facts. May also include speeded flash card drill which is specifically 
aimed at increasing automaticity . 

* 24.3 Multiplication Algorithm s Multiplication with one factor of two or 
more digits, i.e., all multiplication above the basic facts. 

25. DIVISION 

25.1 Division ; division of whole numbers . All levels of difficulty. Includes 
speed tests in division. 
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26. FRACTIONS /DECIMALS 



26.1 Fractions - Recognizing and identifying a fractional part of a set, 
region, or line: 



Examples : 




Draw a ring around 1/3 of 
the trees. 



b. 




What part of this region 
is shaded? 



26.2 Fractions: Computation with fractions including the recognition and 
identification of equivalent fractions. 

26.3 Fractions : Converting decimals into fractions (e.g., .625 - 5/8) 

1 

26.4 Decimals : Place value ( Yoo "'•01, .5 > .25); arithemtic operations 
with decimals (+, x, £). 

27 . SPATIAL . APPLICATION 



27.1 Linear Measurement - Measuring the length, width, or height of 
objects, lines, or pictures. 



27.2 Geometry - Perimeter : Computing the perimeter of a polygon using 
standard or arbitrary units of measure. 

27.3 Geometry - Area : Computing the area of a polygon using £t4ndatfd 
or arbitrary units of measure. 



27.4 Geometry - Number Pairs : Identifying number pairs on a number plane. 
Example: * 











L 


















a. 






ft. 

















What is the number pair for point Q? 
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27.5 Geometry - Lines or Figures ; 

Recognizing and identifying common lines and plane figures. Include 
angles, parallel and perpendicular lines, parallelograms, rectangles 
squares, and right triangles. Does not include work with solid 
figures like spheres, rectangular prisms, etc. 



28.1 Word Problems : All types of word problems including word problems 

with graphs. The coding of word problems is given priority over the 
specific computation required by the problems. Therefore, regardless 
of the computation, time on word problems is coded under word problems. 

29. MATH RELATED 



.1 Money - Identifying coins, the sum of a set of coins, and equivalent 
values of coins. Using coins for practice in addition, subtraction, 
and understanding the decimal system. 



.2 Other Concepts: Other concepts and applications not covered by cod 
20 through 28. 



Volume 

Solid Figures 
Liquid or Weight Measures 
Statistics and Probability 
Constructing Line and Bar Graphs 
Set Theory, Set Diagrams, Logic 
Place Value with Decimals 
Exponents (concepts of) 
Averages (concepts of) 



30. MATH BELOW TEST LEVEL 



30.1 Developmental Activities - Activities which do not involve computation 
but do promote the development of concepts which are considered 
preliminary to the understanding and use of operational concepts. 
Includes: 

A. Review of basic number concepts such as learning the number name 
for a set of objects less than 10, learning to count and write 
the numbers from 0 to 10, one to one matching and recognition 
of equivalent sets. 



28. 



VERBAL APPLICATION 




Examples: 
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Examples: 



three 



0 v o -1 -2- .3- Jl 



How many? 




s 



x 



Activities which provide experiences (most often with concrete 
materials) in recognizing* likenesses and differences, sorting, 
ordering, comparing, and matching. 

Examples: Attribute blocks or games 
Pattern blocks 



Tangrams 

Geoboards 

Geoblocks 



Soma cube puzzle 
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2.13. Content Summary; Other Academic 

40. PHYSICAL/BIOLOGICAL SCIENCES 

- Biology 

- Physics 

- Chemistry 



41. SOCIAL SCIENCES 

- Geography 

- History 

- Social Studies 

- Current Events 



42. FOREIGN LANGUAGE 

- Spanish 

- German 

- French 



2.14. Content Summary; Non-Academic 

50. ART 

51. MUSIC 

52. TECHNOLOGICAL ARTS 

- Industrial Arts 

- Home Economics 

53. PHYSICAL EDUCATION (Supervised) 

54 . PERCEPTUAL DEVELOPMENT 

55. MANAGEMENT /PROCEDURAL 

56. RECREATION /BREAK 

57. PERSONAL EXPERIENCES /FEELINGS 



58. OTHER ACTIVITY 



210 



46 



Other Academic Content Category Definitions 



41* 



PHYSICAL/BIOLOGICAL SCIENCES — An activity primarily involved with knowing 
about matter, energy, plants and animals* 

Examples: a. Physics, chemistry, geology, anatomy, meteorology, 
biology, astronomy. * 



SOCIAL SCIENCES— An activity primarily concerned with humans and their 
living together. 

Examples: a. Social Studies, 



b# Geography (human), 

c. Sociology, pyschology, 

d. Current events, government, politics, 

e. History, 

f . Economics, 

g. Political science, law, 

h. Anthropology, 
j . Art history. 



FOREIGN LANGUAGE— An activity primarily involved with reading, writing, 
or conversing in other than the native tongue. 

Examples: a. Spanish, 



b. French, 

c. Russian, 

d. Latin, 

e. Turkish, 

f. Hebrew ... 



Note: If any math or reading is involved in these other academic 

activities, be sure to code the specific math or reading category 
in addition to the other academic category. 



ART — An activity primarily involved with visual representation for aesthetic 
purposes. 

Examples: a. Sketching, painting, sculpturing, 



b. Film-making, 

c. Silk-screening, tye-dye, 

d. Jewelry making, 

e. Art appreciation. 

f. Drawing, coloring 

g. Making valentines, Christmas cards, room decorations, etc. 
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MUSIC— An activity primarily involved with listening to, making or 
appreciating organized sound. 

Examples: a. Singing, chanting, composing, improvising, 

b. Playing instruments, 

c. Music appreciation, 

d. Rhythm bands. 



TECHNOLOGICAL ARTS-An activity primarily concerned with how to do 
an occupationally or vocationally related skill. 

Examples: a. Wood-crafting, 

b. Bookkeeping, 

c. Computer programming, 

d. Cooking, sewing, decorating, 

e. Gardening, 

f. Shop, 

g. Electrical repair, 

h. Knitting, needlework, macrame. 

PHYSICAL EDUCATION— A supervised and organized activity whose primary 
intent is bodily exercise and/or gross motor development. 

Examples: a. Swimming, 

b. Dance, 

* c. Gymnastics, t , 

d. Calisthentictf, 

e. Team sports. 



PERCEPTUAL DEVELOPMENT (Training)-An activity primarily oriented towards 
sensory and motor (fine) development. 

Examples: a. Tracing sand paper letters, tracing, 

b. Clapping, snapping, 

c. Cutting, pasting, 

d. Mazes, 

e. Eye-hand coordination (following a finger) 

f. Basic (primary) visual discrimination 
skills (colors, shapes). 

MANAGEMENT/PROCEDURAL— Conducting class business unrelated to any 
instructional activity. 

Examples: a. Collecting milk money, 

b. Taking attendance, lunch count, 

c. Making arrangements for a field trip, 

d. Filling out administrative forms, 

e. Morning announcements, 

f. Being sent to principal's office, 

g. Fire drill, 

h. Cleaning up room, stacking chairs. 
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56. RECREATION/BREAK— Any recreational or free period. 

Examples: a. Recess, 

. b. Unstructured P.E. (like recess), 

c. Lunch, milk breaks, 

d. Non-instructional games, 

e. Attending school concert,,, assembly, basketball game 

f. Class party. 

Don't code as break: brief unscheduled -.rips to restroom, 

drinking fountain, etc., unless there 
is a specified period of time for all 
students to do this. 

57. PERSONAL EXPERIENCES/FEELINGS 

57.1 Personal Experiences— Primary focus is on the telling of a past 
experience of the learner or teacher. (Only code if it is clearly the 
focus of the activity, not just in passing.) 

Examples: a. Telling about personal experiences at home or elsewhere, 

b. Show and tell, ' 

c. Talking about experiences on a recent field trip. 

57.2 Personal Feelings— The primary focus is on current emotions of the 
learner or teacher; or feelings about some personal problem he/she 
now owns. (Only code if it is clearly the focus of the activity.) 

Examples: a. Affective education programs, 

b. Discussion of a recent traumatic or exhilarating 
experience (death or injury of a close person, winning 
a tournament) 

c. Discussion of feelings/attitudes about classroom 
problems (e.g., rules, discipline). 

58. OTHER ACTIVITY — Some organized instructional activity that cannot be 

clearly coded by any of the above content categories. Be sure to describe. 
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. 3,1 Defin itio n s of Real-Ti^ Coding Categoil ^ f or Target StnH.n-, 
Instructor and Focus ti 



These categories are to be used for coding on the Real-Time Sheet onlv 
for educational activities which require the target student to engage in any 

ciaU^rH theraa ^? S ^J"^ task ™ n though the subject ^fo ?^ 
cially called something else (e.g., science, social studies, music). 



Learner Moves (Target Student [TS] only) 
EW: ENGAGED-WRITTEN 



TS makes a substantive non-oral (usually motoric) reading or 
math response that allows the observer to determinp *n Ra p 0 mon- 
and task difficulty level directly . "~ 

c 

Examples: - writing answers to math or reading problems/questions 

- measuring in math 

- using manipulatives in math (e.g., cuisenaire rods, abacus, 
pocket calculator) *' 

- writing spelling words 

- drawing a geometric figure in math 

- capitalizing and punctuating a sentence on worksheet 

- circling an answer on a language arts task 

EO: ENGAGED-ORAL 



TS makes a substantive oral response in math or reading that . 
allows the observer to determine engagement and task dif ficult 
level directly . . T"^ s 

Examples: - oral reading^ 

- .answering a substantive question in reading/math 

- asking a substantive question in reading/math 

- making a relevant comment in reading/math 

- singing while reading lyrics 



EW and EO are not used for TS responses concerning the directions 
or structure of the task— see ED below. EW and EO must pertain 
to the substance of the task itself. 



EC: ENGAGED-COVERT 

TS is oriented to the substance of a reading/math task, but is showing 
no observable response that allows the observer to determine engagement 
and task difficulty level directly . 
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Examples: - silently reading and listening to another student read orally, 

- watching T demonstrate how to do a math problem at board 

- listening to questions and answers about a story that was 
re^d 

- silent reading of ter.t 

- pondering over a stor^problem 'in math 

- listening to T explanation on suffixes and prefixes 



Note: EC is not used for TS behavior related to the directions or 
structure of the task— see ED below. 



ED: ENGAGED-DIRECTIONS 

TS is' engaged in listening to, reading, asking about, or carrying 
out directions that do not involve the academic substance of the 
reading/math task itself. (The response mode is not differentiated 
here. ) 

Examples: - TS is writing name on top of paper and numbering lines for 
spelling words to be given. 

- TS is listening to T give the next math assignment. 

- TS asks a question about what s/he's supposed to do on the 
reading assignment. 

- TS is copying directions from the board for the math 
seatwork. 




TS is involved with some activity that is part of a reading?math task, 
but does not involve the substantive content or directions ^of the task. 

Examples: - sharpening pencil * 

- hands in paper 

- getting books, relevant materials ^ 

- opening book, finding page 

- checking off on a chart items completed during task 

- passing out papers 

Ground Rule : Code engagemen'. over non-engagement if both occur together — e.g., 
If T is giving directions and TS is listening while also filling 
his/her pencil and page in the math book, code ED, not NI. 

NW: NOV ENGAGED -WAIT 

TS is not engaged in a reading/math task because s/he is 
waiting for the teacher or another student, 

Examples: - waiting for help from T 

walking up to T's desk and waiting for his/her paper 
to be graded 

- waiting for T to return to the group that TS is in and 
which cannot continue without T 
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-.waiting forT or another S to pass out papers 

- waiting for T to write problems on the board 

- waits for T to give next spelling word 

- TS has finished current part of task and is waiting for 
next part • 
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, Note: If TS is NW then code instructor move as NULL. 



NO: NOT ENGAGED - OFF TASK 

TS is not involved In. the reading/math task in any way, not 
even in a peripheral part of the task. 

Examples: - Socializing 

- Daydreaming 

- Disruptive behavior 

- Doodling, passing notes 

- Shuffling aimlessly through text pages 

- Getting a drink, going to restroom 



Note: Teacher disapproval is not a necessary condition for NO. 



Ground Rule: 



TS engagemen t in reading/math always takes priority over non- 
etigagement in. some other task. We always want to know when 
TS is engaged in reading or math, regardless of what other 
intentions the teacher may have. For example, suppose the 
"official" activity is art— all the students are expected 
to work on their collages during the art period, but TS 
decides instead to read a book from the library. From the 
point of view of the art activity, TS is NO (not engaged- 
off task). However, TS is engaged in reading (EC). In this 
case, the observer should code the content on the educational 
activity sheet as reading practice (// 14) (not art), and code 
TS engagement from the point of view of the reading activity 
(EC). , ay 



Instructor Moves 

General Note : The instructor is usually the classroom teacher, but 
need not be. Another student could be tutoring TS — thus the peer is 
the instructor. The instructor could also bo nn aide, a teaching 
machine, or even the curriculum materials if they provide feedback 
to TS on his/her responses. You will code vho the instructor is on 
the educational activity sheet. You will code the instructor move 
on the real-time coding sheet, regardless of who or what the instructor 
is, only when: 
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1. The instructor move Is relevant to the reading 
or math content ; AND 

2. The instructor move is relevant to the TS move 
coded for that event. 

* 

AM: ACADEMIC MONITORING 

An instructional move that consists only of looking at or 
listening to a TS response during a reading/math task. It 
must be directed toward the substantive, academic responses 
of the TS, (Observation of TS task engagement, where the 
instructor is not in a position to evaluate how well TS is doing 
on the task, is not AM — it is null.) 

T stops at TS's desk :nd looks at his/her work (written 
responses during math seatowrk) 
T watches TS work math problem at board. 
T looks at TS's spelling words during spelling test. 



Notes Suppose TS is engaged in math seatwork (EW), and T is 
monitoring some other student's seatwork responses. 
This would not be coded AM, because the instructor move 
is not relevant to the TS move . In this case the 
instructor move is NULL, with respect to TS's move. 



AF: ACADEMIC FEEDBACK 

The instructor informs TS that TS 1 ^ written/oral response in math/ 
reading was correct or incorrect, or provides TS with the correct 
response but no explanation is given as to why it is correct. 

AF can be implicit as in TS oral 'reading, when T is listening — by 
not stopping TS, T is implying that TS is reading correctly. Or 
flash card drill in math, when T goes to next card without comment 
it implies that TS was correct on the last one. 

Examples: - T says to TS, "Good. That's right. " 

~ T says to TS, "No, the answer is 53.". 

- TS looks at T marks and corrections on his spelling test 
(only code AF when TS is actually looking at the .written 
feedback) . 

- A peer is grading TS f s math qui2 (students have traded papers 
and T is going over the answers with class), and peer says 

to TS; M You got that one right." 

- TS is checking his math problems against answers in back 
of book (or on another sheet) 

- Another student is reading orally and TS is silently reading 
(following along). 
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- TS is. listening to audiotape/record and silently reading along 

- TS is in group singing and reading lyrics, and if T can be 
heard above the rest, this is AF (to the group) 

- T is going over answers to reading assignment so that TS can 
follow along, and TS is correcting his/her own paper 

- T listens to several of TS's oral answers and only stops TS 
if TS makes a mistake (i.e., it is implied that TS is correct 
by lack of T interruption) . 

AQs ACADEMIC QUESTION 

The instructor is asking TS to provide a written or oral answer 
to a substantive reading/math problem or question. 

Examples: - Spelling— TS is required to spell a word aloud or on paper. 

- T reads a passage aloud from which TS is to find a certain 
type of word. 

- A peer shows TS a flash card and TS is supposed to respond. 1 

- T gives a test orally to class on a problem x problem basis— 
i.e., "No. 3. Which countries were concerned about the seals'" 
(in a story just read silently). 

XN: EXPLANATION - NEED 

The instructor is giving an explanat oi- hat is provided to satisfy 
a clear and immediate need for TS hel H rfith a substanti ve reading/' 
math problem. ■ 

Examples: - TS is unable to do task or has done it wrong, and T reacts 

to this by explaining (note if TS is confused about directions, 
code the T clarification as SD— see below). 
~ TS asks for help on a problem and T provides it. 

- Most of the class, clearly including TS as well, are confused 
about how to do a problem, so T gives an explanation to the 
whole class (group focus) . 

XP : EXPLANATION - PLANNED 

The instructor gives explanations on substantive content in math/ 
reading that do not pertain to an immediate academic need of the T^. 

Examples: - T is lecturing on pronoun reference. 

- T is demonstrating a long division problem. 

- TS is watching a movie/TV filmstrip where reading/math 
instruction U being given (e.g., Sesame Street). 



Note: If TS is listening to an explanation based on an immediate' 
need of another student, but TS clearly does not have that 
need, code XP for TS, not XN. 
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SD: STRUCTURING - DIRECTING 

The instructor makes statements about goals or objectives and/or 
gives directions on a math/reading task. 

Note-- the statements do not involve the substance of the reading/ 
math content, but are about what the students are to do on the 
task or why they are to do it. 

Note also — any instructor questions, feedback, explanations, 
monitoring, etc. that have to do with the structure or directions 
a bout the task are coded as SD (not XP, XN, FB, AM) • 

Examples: - T says,. "Open your math books to page 72, and do problems . 
3, 5, and 8 M . 

- T says, M We need to learn how to spell correctly, so that 
other people can read what we write 11 . 

- T goes over the schedule of activities for the language 
arts period. 

- T briefly reviews the part of the story covered the previous 
day before beginning an oral reading activity: M We left off 
the story yesterday when Sammy couldn't find his mother at 
the grocery store. We were on page 49, the second paragraph. 
Has everybody found his or her place? Who would like to read 
first?" 

TF: TASK ENGAGEMENT FEEDBACK 

The instructor moves to control inappropriate TS task engagement or 
to praise positive TS task engagement in math/reading. (This is never 
" used when instructor is giving feedback relating to the content of TS's 
academic responses.) 

Examples: - To TS: "Get back to work." 

- To TS: "I see you're really working hard on this reading 
assignment." 

- To group including TS: "Have you finished your math assignment 
yet?" 

- To TS: "Stop that (talking) and finish your spelling words. 1 " 

- To group including TS: "1 see that everyone's almost finished, 
and we have 10 minutes loft in the math period!" 

- To TS: "Shh! I don't want to have to remind you again to 
be QUIET." 



NU: NULL 

The instructor move during a math/reading task not relevant to the 
TS move coded for that event OR it is not relevant in any way to the 
reading/math task itself. 

Examples: - TS is EW on math worksheet at seat and instructor is grading 
papers at her desk. 
- TS is NO on reading assignment, and Instructor is individually 
helping another student. 
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- Instructor is out of room and TS is EC in reading science 
book. 

- Instructor is working with reading eroup of which TS is not 
a member, and TS is copying spelling words at seat. 

- During oral reading group, T interrupts and says, "oh, I 
forgot to take lunch count." 

- During math seatwork. T says, "Wasn't that an excitine ball 
game last night?" (TS is listening to T) . (This would be 
coded NO and NU) . 

p 

Sometimes it can be confusing as to whether to code NU or one of the 
^other instructor moves. For example, suppose T is at board demonstrating 

along division problem, but TS i<s whispering to a friend (off-task). 

T s behavior is- not relevant to TS's but it is relevant to the task. 
' Since TS is clearly supposed to be listening to T, this would be coded 

NO and XP. 

On the other hand, suppose that during math seatwork, TS is EW, T 
starts to talk to the class about last night's game, but TS ignores 
T and continues to work." Th^s would be coded EW and NU. 

Or, suppose in math seatwork TS is off-task and T says to TS, "Be 
quiet and finish your worksheet." In this case you would code NO and 
TF. The instructor move is relevant to TS's non-engagement in math. 

» 

Thus, there are two questions to answer: 

1. Is the instructor move in a math/reading activity intended 
for TS engagement at this time? (If not, code NU for the 
Instructor) . 

2. If so, then is the instructor move related to the substance 
or directions of the TS math/reading task OR to TS's 
engagement in that task? (If not, code NU for the instructor. 
Otherwise, code accordingly as AM, AQ, AF, XN,- XP, SD, or TF.) 

What about this situation? Suppose T is demonstrating long division at 
the board and TS is suppose to watch, but is instead reading a library 
book. First, do we code TS as EC in reading or NO in math? The ground 
rule is to code TS engagement in math/reading over non-engagement. Thus, 
the content category should be coded as Reading Practice (// 14) , and 
the TS move as EC. Since, the instructor's move is unrelated to TS's 
engagement in reading , it is coded as NU. 

Focus of Instructor 

Here we want to distinguish between instructor moves directed specifically 
to TS vs. those directed to someone else in the group (of which TS is a member) 
or to the group as a whole. The focus is coded in addition to the type of 
instructor move (see above). 
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TS: TARGET STUDENT IS FOCUS 

The instructor move is clearly and specifically directed to the TS, 

Examples: - TS is having difficulty with a math problem and T Is giving 
TS ^dividual help. 

- T says to TS in oral reading after a TS miscue, "Look at 
the first two letters. What sound do they make?" 

- T is looking over TS's shoulder while monitoring seatwork. 

- T tells TS to stop talking and get back to work. 

- T tells TS, "That's correct. Go on. 11 

GR: GROUP IS FOCUS 

The instructor move is directed toward another student in the group 
(of which TS is a member) or to the group as a whole? 

Examples: - To reading group: "Who can tell me what happened to Bobby 
(in the story just read)? 11 

- To another S in reading group whu ban made a miscue (and 
TS is supposed to listen): "Look at the first two letters. 
What sound do they make?" ' 

- Whole class is going over spelling test and T says, "The 
first word is spelled, B-E-A-U-T-I-F-U-L. 11 \ 

- T is demonstrating long division at board to whole class. 

- T is correcting another S's mistake on math problem and 
TS is listening and watching. 



Note: If the instructor move is coded as NULL, then the focus must 
be coded NULL as well. 



Procedures for Real-Time Coding in Math/Reading 

When an activity ACTUALLY begins you record the time started on 
the Educational Activity Sheet. At this time, you may not know if the 
activity will involve any TS math or reading related tasks. To be safe, 
you should begin coding on the Real Time Coding Sheet, until it is clonr 
if a math/reading task is involved. If not, then cross out the real-Lime 
codes you have made thus far and discontinue real-time coding. Otherwise, 
continue real-time coding until the math/reading activity ACTUALLY 
ends for TS. 

The procedure we will use for real-tine coding is called "point-time 
sampling". We will not code every TS move, instructor move and focus, 
but only c pd^jwhat is occurring at one-minute intervals . Since we only 
sample every minute, we will lose some information about TS and instructor 
behavior, but this is off-set by the many days of observatiotrfor a ^±v^r\ 
TS. More importantly, it makes your job as a coder much easier than if you 
were required to code continuously in real-time throughout math/reading 
activities. 
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rine durtt\l P U " 8 P° lnt » **** a ""ental snapshot" of what is occur- 
ti±Li" n It T SeC ° nds ( a PP roxi ^tely). Then you record four 

tatT aIS* t , me 3t SampUn8 P ° lnt; 2) the TS mov ^ 3) the instructor 
noln } lns J ructor focus ' T hen you wait until the next sam^ng 

point and record again, etc., until the end of the activity. While vou 

TseZnt ^ n ?he1rr/ri ln8 P ° lntS * y ° U W ° n,t be COdln8 b " £ be 
ne^riaSpHnl p" S ° ^ y ° U WlU kn0W the COntext f °r 'he 

rW When /°" code « th ^ "mental snapshot" should reflect the relationship 
rnntnr h «» TS move and instructor move and focus thaTl^st 

SSTrr^T ' , F ° r eXample ' at the sam P lin8 Po^t (11:08 a.m.) 
snppuso I Is demonstrating to the class long division problems at the board 
and TS is watching. This wWd be coded: 

ALTOS 

REAL-TIME CODING SHEET 



TIME 


1. LEARNER 


INSTRUCTOR 






MOVES 


2. MOVES 3. FOCUS 


i i ; 0 






XP j HR 








i I" 



Lone 



NOTES 
division demo 



At 11:09, during the demonstration, TS is whispering to a peer. This 
would be coded: 











1 




1 


1 : 0 


9 


■ NO 


XP J CR 


v ■ 

Long division demo 



At 11:10, the poacher specifically reprimands TS, who listens to T: 











1 ' I 






2 s 2 


0 


NO 


1 

TF I TS 


"Pay attention" 










i 





Note here, that when T gives the reprimand (TF) , TS is paying attention to 
the reprimand at the sampling moment, but the T behavior is related to TS's 
previous off-task behavior. Thus, we capture the sequential relationship 
between the teacher and learner behaviors, by coding the NO to which the TF 
refers. 

At 11:11, the teacher answers TS's question about the directions for 
the math assignment: 



1 : / 



ED 



SD | TS 



TS confusod nbout ussiLinmont 



Again, the SD refers to TS's prior question (ED) about what to do on the 
assignment. 
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At*** 1 **;** *? the ] e880n > TS asks ' a question about a problem he is having 
difficulty with and T proceeds to help him: 











1 








I J 2 


9 


EO 


XN 1 TS 


1 


TS stuck on problem 










i 


n — • ■ 



Here, the XN refers to the question (EO) asked by the TS: 

The sequence could also be from T to TS, as T asks a question in 
reading at the sampling moment, and TS then answers orally: 











\— 1 


* 




9 : 3 


2 


EO 


i 

AO | TS 

















Here, the EO follows the AQ, and is coded because it is part of the sequence 
of events at the sampling point. 

These prior/posterior sampling codes only pertain to when there is 
a direct interaction between the instructor and TS. In these situations 
we want to best capture their interaction. In other situations, the 
sampling point will consist of simultaneous codes for the ongoing event 
For example, another student is reading orally, TS is following along, 
reading silently, and T is acknowledging the correct reading of the other 
student by allowing him to continue: 











1 ' • 




0 

n — 1 


9 : I 


5 


EC 


1 

AF I GR 

i » 


Oral readincr 



At the sampling moment, TS is EC and AF is to the reading group (the other 
student), and thus, the AF is relevant to TS's silent reading. 



What to D o When Multiple Events Occur at the Sampling P oint 

Sometimes the interaction will be so fast that several Uvuner moves 
or instructor moves occurred during the ftvo-socond lntorv.il in wliicli you 
took a "mental snapshot" at the one-minute sampling point. For example 
TS may ask a substantive question (EO) to which T listens (AM) and then' 
T answers TS's question (XN) while TS listens to the explanation (EC) 
All of this occurs right at the sampling point. Which codes should you' 
record? To help you make this decision, priority heirarchies are given for 
TS and instructor moves: 



Priority Hierarchy for TS Moves : 



1. EW and EO 

2. EC 

3. ED 

A. . NI, NW, NO 



Engagement always takes 
precedence over non-engagement, 
if both occur together. 
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Priority Hierarchy for Instructor Moves ! 

1. XN 

2. ^XP 

3. AF and AQ 
A. AM 

5. SD 

6. NU 

In the above example, you should have coded, according to the hierarchie 















t 


9 : 3 


4 


EO 


XN .. ! TS 


i 















Since EO takes precedence over EC, you should code EO, and since 
XN takes precedence over AM, you should code XN. 

As another example, if T is listening to TS read orally (AM) but 
also implies that TS is reading correctly by not interrupting (AF) , then 
you would code AF for the instructor move, since AF takes precedence 
over AM. Or, if T gives feedback (AF) and also an explanation as to 
why TS s response was incorrect (e.g., "No, receive is spelled R-E-C-E-I-V-E. 
.. Remember the rule: i before e except after c "), you would code XN, because 
XN takes priority over AF. eOr, if TS"is listening to T directions (ED) 
while also getting materials for the task (NI) , you would code ED, since 
ED takes priority over NT. 

Remember, however, that these priority rules apply only when multiple 
TS or instructor move* occur right at the sampling point. Otherwise, if 
there is only a single TS and instructor behavior each occurring at the 
sampling point, then you simply code them. For example, it may have been 
the case that 30 seconds prior to the sampling point TS asked a question 
which T answered, but later at the sampling point T has continued the 
lecture and TS is listening. Here you would .code EC and XP, since the earlier 
EO and^XN did not occur during the sampling point. 



Ground Rule for Real-Time Coding of Reading/Math in Other Content Areas 

Sometimes reading or math tasks will occur within another content 
area (e.g., in science, social studies, music), but the reading/math 
tasks occupy only a small portion of the overall activity in the other 
content area. That is, the reading/math tasks are not the principal 
part of the activity. For example, in a half-hour music, lesson, only 10 
minutes -may be devoted to reading the lyrics during choral singing and the 
remaining 20 minutes are spent practicing on musical instruments. Should 
you code in real-time for the entire half hour? No. 
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Ground Rul e; You only need to real-time code during the part of the 
other" content_area in which reading/math t asks arP 
requi red. 

Thus in the above .msic lesson you would only code in real-time durina 
the lyrics reading and choral singing, since that is the only part of the 
activity which required reading. 

However, remember that this ground rule applies only when math/readine 
is coded as the SECONDARY content area on the. educational activity sheet 
Whenever math or reading is the PRIMARY content area, then you must real- 
time code for the entire duration of the activity. 
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Intr oduction 

We expect you to keep a log on academic activities for selected 
students in your classroom for a period of 10 weeks during this semester 
(not counting the week of vacation at Spring Break) . Once you have learned 
how to use the log forms provided, It should take no more than 5 minutes 
of your time per day per target student on whom you keep a log. 

An entire student log Is organized Into 10 booklets, one for each 
week. Each booklet has a cover sheet plus 5 pages stapled together. The 
cover sheet serves to Identify you, your target student, your school, and 
the dates of the week. Each of the remaining 5 pages In a booklet Is 
used for logging each day of that week. Completed log booklets will be 
collected on a weekly basis. ♦ 

Important —you only need to record ACADEMIC ACTIVITIES In the logs . 
/ and only those Intended for the TARGET STUDENT . An academic activity is 
one which involves reading (language arts— including spelling, grammar, 
and composition), mathematics, science, social studies, or foreign language. 
You should not record non-academic activities such as music, art, recess, 
physical education, lunch, free time, etc., in the logs. * 

Take a few minutes now to look at the directions and sample log on 
the next several pages. Note that you will keep a separate log for each 
selected target student, so that one booklet represents the academic 
activities for one student for one week. 
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Directions for Completing the Lor 

1. Complete the cover sheet (at the beginning of the week): 

-student name 
-your name 
-school 

-dates of this week 

2. Complete a log sheet for each day: 

-Circle the proper day at the top. 

-Use one line for each academic activity: 



a) Enter the academic subject area codp number(s) which 
describes the type of activity the target student was 
expected to do. (See appendix for definitions and 
examples of each type of activity). 



b) Briefly describe the task required of the target student 
in terras of student behavior ( e.g. , read orally; solve 
long division problems (like 42)234 ); write answers to 
reading comprehension questions; respond to vocabulary 
flash card drill; watch movie; listen to and discuss 
current events; copy spelling words; write book report). 

c) Indicate the times at which this activity started and 
stopped (e.g., 9:15 to 9:45). Please try to be accurate 
to the nearest five minutes for starting and stopping 
times. 

d) Circle the target student success rate for this activity 
as HI, MED, or LO. Note the definitions given on the 
bottom of the log sheets. Success rate applies to the 
activity as a whole . So, for example, if the target 
student did one part of the activity ^ jty well and 
another part very poorly, you would circle MEDium. If 
the target student does very well on all parts of the 
task you would circle High; ox if the target student does 
very poorly on all parts of the task you would circle LOw. 

e> Indicate specific materials used (e.g., teacher-made math 
worksheet; Cuiscnaire rods; D I STAR II Math, pages 81-82; 
Cat in the Hat (Dr. Suess), pages 1-9; On Sets (game— Layman 
Allen); multiplication facts flash cards; basic addition 
speed test; SRA Reading 1 workbook, page 23). 

f) Repeat steps 2a to 2e for each academic activity that day. 
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Note: If the target student is absent, write 
"ABSENT" on the log sheet for that day. 
Do not log activities for which the 
target student was not present. 



3. At the end of the week, check over the booklet to make sure it is 
complete. Then write any pertinent comments on the cover sheet 

< e '8'» has been ill and not back to full strength yet. She 

got over-tired and so didn't complete or try to do many activities." 

or ■ — ■ 8 r andmother died last week. He's just not himself lately 

moody, can't concentrate . This is not typical of his usual work.") 
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WEEKLY TEACHER LOG OF STUDENT ACTIVITIES 

Target Student: Teacher: ^kiM. ^<°» 

5 fauWhSi/y (tyn+nifaiy 



Dates (week of) : 3 A, thru J A/>J School 

Monday Friday 



Special Comments on Target Student Activities this Week: 

d/ce**t? <ni /»a^. ' ucoa*/ ^/ 
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CIRCLE DAY 




Monday 



Tuesday 



Wednesday 



Thursday 



Friday 




*Co„ £e „ t codes toy -J-;- "* " he " " «ch describe 



READING 

10. Decoding/Phonics 

11. Word Structure 

12. Word Meaning 

13. Comprehension 

14. Reading Practice 

15. Spelling 

16 Grammar 

17 Co, position (Creative Writing) 

18 Reading Related— Other 
19. Reading Below Test Level 



MATH 

20. Addition/Subtraction (no regrorpitio) 

21. Addition/Subtraction (with regrouping) 

22. Computational Transfer 

23. Place Value/Numerals 

24. Multiplication 

25. Division 

26. Fractions/Decimals 

27. Spatial Application 

28. Verbal Application (word problems) 

29. Math Related— Other 

30. Math Below Test Level 



OTHER ACADEMIC 

40. Science 

41. Social Studies 

42. Foreign Language 

43. Other— Specify 



** 



(copying) 

med s sS s : ZtlTmZ T ekea on the task (errors due to "<i-~»> • 

LO SUCCESS - -Jj^tjU^Mta. „ r unable or no aetempt t „ d0 Mgk (Mtrect answets ^ 
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CIRCLE DAY 



Monday 




Tuesday 



Wednesday 



Thursday 



Friday" 



.0 : 
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Academic Subject 
Area Code(s)* 



/7 Co*0cstf/o/i 



rt&b, Axe fee 



Task Required 
of Target Student 



assignee/ tip/c 



Times 
Started Stopped 



Kr to ti/f 



/c 



TO fa : 0O 



/$ TO /a: JO 



30 TO /axViT 



V? TO //:Ja 




Target Student 
Success Rate** 



HI 



(MED) 



LO 



HI 



MED 



/KM AJr Jh*J.* 



HI 



LO 



<5> 



MED 



LO 



MED 



LO 



Specific 
Materials Used 



TeajUer finite b'sf 



'Content Codes (only use more than one code per task when it has multiple parts, each describable 
by a different content code): 



READING 

10. Decoding/Phonics 20. 

11. Word Structure 21. 

12. Word Meaning 22. 

13. Comprehension 23. 

14. Reading Practice 24. 

15. Spelling 25. 

16 Grammar 26. 

17 Composition (Creative Writing) 27. 

18 Reading Related— Other 28. 
19. Reading Below Test Level 29. 

(copying) 30. 



** HI SUCCESS - made few or no mistakes 
MED SUCCESS- between HI and LO. 
LO SUCCESS «■ made almost all mistakes 
chance or luck) . 



MATH 

Addition/Subtraction (no regrouping) 
Addition/Subtraction (with regrouping) 
Computational Transfer 
Place Value/Numerals 
Multiplication 
Division 

Fractions/Decimals 

Spatial Application 

Verbal Application (word problems) 

Math Related— Other 

Math Below T«st Level 

on the task (errors due to carelessness) . 



OTHER ACADEMIC 

40. Science 

41. Social Studies 

42. Foreign Language 

43. Other— Specify 



or unable or no attempt to do task (correct answers due to 
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CIRCLE DAY 



Monday 



Tuesday 



Wednesday 



Thursday 



Academic Subject 
Area Code (s)* 



/Vty. A*c/t<r& 



A2 /&/></ /fofitoa 



Task Required 
of Target Student 



4b Sc/e/>ce 



Times 
Started Stopped 



9\lfr TO f\M 

fiao to pi jo 



9 ''SO TO 



9\i% TO /6\00 



/OXOd TO /c\/f 




Target Student 
Success Rate** 



® 

HI 



MED 

(med) 



LO 



HI 



MED 



HI 



LO 



Friday 



Specific 
Materials Used 

Scot? AbtesitoJl 



Af># /ere/ 3 



* content codes ir^uizt i h z e T"£r task when " h - — -"«-«. 



READING 

10. Decoding/Phonics 

11. Word Structure 

12. Word Meaning 

13. Comprehension 

14. Reading Practice 

15. Spelling 

16 Grammar 

17 Composition (Creative Writing) 

18 Reading Related—Other 
19. Reading Below Test Level 

(copying) 



MATH 

20. Addition/Subtraction (no regrouping 

21. Addition/Subtraction (with regrouping) 

22. Computational Transfer 
Place Value/Numerals 
Multiplication 
Division 

Fractions /Decimals 
Spatial Application 
Verbal Application (word problems) 
Math Related— Other 
Math Below Test Level 



23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 



OTHER ACADEMIC 

40. Science 

41. Social Studies 

42. Foreign Language 

43. Other — Specify 



** is %i: e ir H rz r akes on the ta8k (ert °" due <° «— «-«> • 

brie 239 L ° SUCCESS * chle 1 :?" uc a i) 1 . ni8takes or unable or no atte "" ,t t0 d0 " 8k < cor "« *» f 
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CIRCLE DAY 



Academic Subject 
Area Code(s)* 




Task Required 
of Target Student 



Times 
Started Stopped 



Target Student 
Success Rate** 



// Uorc/ S/r&c/itst 



Specific 
Materials Used 

let*/ 3 




TO 



HI 



MED 



LO 



* content codes iTiVuizt i^zMZr task when u has muitipie -* <°°^ 



READING 

10. Decoding/Phonics 

11. Word Structure 

12. Word Meaning 

13. Comprehension 
Reading Practice 
Spelling 
Grammar 

Composition (Creative Writing) 
Reading Related— Other 
Reading Below Test Level 
(copying) 



14. 

15. 

16 

17 

18 

19. 



20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 



MATH 

Addition/Subtraction (no regrouping) 

Addition/Subtraction (with regrouping) 

Computational Transfer 

Place Value/Numerals 

Multiplication 

Division 

Fractions/Decimals 

Spatial Application 

Verbal Application (word problems) 

Math Related— Other 

Math Below Test Level 



OTHER ACADEMIC 

40. Science 

41. Social Studies 

42. Foreign Language 

43. Other— Specify 



** HI SUCCESS - made few or no mistakes 
MED SUCCESS- between HI and LO. 
LO SUCCESS - made almost all mistakes 
chance or luck). 



on the task (errors due to carelessness) . 
or unable or no attempt to do task (correct answers due to 



CIRCLE DAY 




Content Codes « „. ^Jfiv, r u* when it Has multiple parts, each describable 



READING 

10. Decoding/Phonics 

11. Word Structure 

12. Word Meaning 

13. Comprehension 
Reading Practice 
Spelling 
Grammar 

Composition (Creative Writing) 
Reading Related— Other 
Reading Below Test Level 
(copying) 



14. 
15. 
16 
17 
18 
15. 



20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 



** HI SUCCESS - 
MED SUCCESS' 
LO SUCCESS • 



made few or no mistakes 
between HI and LO. 
made almost all mistakes 
chance or luck). 



MATH 

Addition/Subtraction (no regrouping) 
Addition/Subtraction (with regrouping) 
Computational Transfer 
Place Value/Numerals 
Multiplication 
Division 
Fractions/Decimals 
Spatial Application 
Verbal Application (word problems) 
Math Related-Bother 
Math Below Test Level 

on the task (errors due to carelessness) . 



OTHER ACADEMIC 

40. Science 

41. Social Studies 

42. Foreign Language 

43. Other— Specify 
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or unable or no attempt to do task (correct answers due to 



17 
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. 4 2.11. Reading. Content Cate goric Summary 
Category// Category. Name 



10. 



DECODING/PHONICS 

-single consonants 

-consonant blends and digraphs 

-variant consonants (c or g) 

-short vowels 

-long vowels 

-other decoding 



EXAMPLES 



11. 



WORD STRUCTURE 

-compound words 

-root words and affixes 

-syllables 



12. 



13. 



WORD MEANING 
-synonyms 

-pronoun reference, 
-other word meaning 



COMPREHENSION 

-verbatim (no rephrasing) 
-translation (paraphrase) 
-inference/synthesis 
-identifying main ideas 
-evaluation of fact and opinion 
• -other comprehension 



14. 



READING PRACTICE 

-sight words (general practice at reading single words') 
-oral reading of text ♦ 
-silent reading of text , 
-reading in content areas 
-listening while reading 



15. 



READING RELATED - SPELLING 



16. 



READING RELATED - GRAMMAR 



; o 
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Reading Content Category 
0 Definitions 

10. DECODING/PHONICS — learning letter-sound correspondences 

A number of different tasks can be used In exercises aimed at teaching 
decoding; for example: B 

a. The child could be asked to give the sound associated with 
a particular letter or group of letters. 

b. The child could be asked to read words with a common sound 
or with a rhyming pattern. 

c. The child could be asked to recognize or identify a word 
containing a particular sound. 

d. The child could be asked to write words with a particular 
sound. (Spelling or dictation are decoding tasks when they 
focus on a particular spelling pattern.) 

e. The child could be asked to match words containing the same 
sound. 

f . The child could be asked to locate all the words in a list 
or story which have a particular sound or spelling pattern. 

g. Even fill-in-the blank exercise can be decoding, if the choice 
the student must make depends on and teaches accurate decoding, 

For example: 

Mary put the around the package. 

sting 
bring 
stripg 

What these tasks (and others not listed) have in common is that they 
pair particular letters or groups of letters with particular sounds 
and they teach students to make the association. 

it 

Note: Sometimes, particularly in some basal reader programs, students 
will read single words where the lesson does not focus on a par- 
ticular spelling-sound correspondence. This would be coded as 
reading practice (//14)— sight words. See that category for 
further discussion. 
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10.1. Single Consonants 

Single consonants located in any position in a syllable or word. 
Examples: ft/ in tan, bat, ate 

10.2. Consbnant Blends and Digraphs 

Common combinations of consonants, located in any position in a 
syllable or word. 

Examples: Blends include st, tr, fl, cr, sp, spr,. thr, nd, etc. 
as in flower, spread, sand 

Digraphs include sh, ch, th, wh as in where, thin, wash. 

10.3. Variant Consonants (c or g) 

Most consonants have one dominant letter-sound correspondence. Some 
consonants are variable; they have 2 common patterns. 

Examples: cat vs. city; jjpat vs. gentle 

Tasks: To fall in this c* # -sgory, teaching tasks should compare and 
contrast the two d codings of the same letter. The student 
might have to decide which sound was appropriate in a 
particular word, or with a particular vowel following 
. the consonant (ca vs. ci) . 

10. A. «Short Vowels ^ 

Regular short vowel sounds of a, e, i, o, u. . 
Examples: bat, red, sick, pond, fun 

10.5. Long Vowels $ 
Regular long vowel sounds of a, e, i, o, u. 

Two major types of spelling patterns produce these sounds - final 
jb and digraphs. 

Examples: bake; rain 

these; mean, feet 
fine 

pole; boat 
huge' 
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10.6. Other Decoding 

Xht be'uugh^ Cate8 ° rieS ab0Ve ' other s P ecific ^coding patterns 

Examples: Complex vowel combinations such as dipthongs (oi, ou, oo 
aw, etc.) 

Sounds of "y" as a vowel (as in cry, candy) 

Effects of consonant context on vowel decoding (vowels 

followed by "r" as in cart or fair; vowels followed by 

"1", as in tall) J 

Silent consonants (know, ghost) 

Etc. 



ERIC 



11.0 WORD STRUCTURE - analysis and meaning of word parts 

11.1 Compound Words 

Two meaningful words are combined to form a new word, which takes 
its meaning from the parts. 

Examples, mailbox, goldfish 

Tasks: Students might be asked to identify the parts, combine parts 
to create new words, or identify words which are compounds. 

11.2 Root Words and Affixes 

Prefixes and/or suffixes added to a root word 

Examples: suffixes like -ly, -f u l, -less, -able, -er, -est, -tion, etc. 

prefixes like un-, re-, mis-, trans-, pre-, ex-, in-, etc. 

grammatical endings like -s, -ed, -ing 

(Includes spelling changes like doubling the consonant, 
dropping the final e, or changing y to i. Also includes 
irregular forms like go, goes, went, gone, going.) 

Tasks: Students might have to identify root words, identify affixes 
in words, or add affixes to words. Includes work on the 
meanln K. of affixes and on the correct use of word forms in 
sentences (John is up the street.) 

walk 

walked 

walking 

The student might have to decide which prefix or suffix was 
needed to create a particular meaning, or the student might 
have to figure out the meaning of a word from the meaning 
of the parts. 
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11.3. Syllables 

Conventional or sound-based units rather than meaningful units. 
Examples: demonstration - dem on stra' tion (4 syllables) 

Tasks: Students might have to identify the first or last syllable 
in a word, or break a word into syllables, or determine 
the number of syllables in a word. , Included work on locating 
the accent or stress in a word. 



12.0. WORD MEANING — Understanding the meaning of a specific 

word or phrase 

12.1. Synonyms 

Two words which mean about the same thing. 

Examples: vibrating ship « shaking ship 

discover a cave 58 find a cave 

little - small 

everyone « all 

Tasks: Students might be asked to name a word that means the same 
thing as another word. Or students might be asked to match 
words that are synonyms. 

12. 2 Pronoun reference 

The meaning of a pronoun comes from the noun to which it refers. 

Examples: Lisa tried to open the window. 
It was stuck. 

(What does "it" mean? window ) 

Tasks: The student might be asked to identify the noun a pronoun 

refers to (as above). Or the student might be asked to fill 
in the appropriate pronoun for an incomplete sentence. 

(John handed the teacher homework paper.) 

her 
. his 
its 

12.3. Other wcrd meaning 

Meanings of words alone or in the context of a sentence 

Examples: Definitions, including using dictionary entries to 
define words 

Defining words from context (using the meaning of a 
sentence to figure out the meaning of an unfamiliar 
0 word or a word with multiple meanings) 
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John used the term "habeas corpus" in his speech 
about law. 

term means 

A. a period of time 

B. an assigned time to serve 

C. a word with an exact meaning 

D. a condition or requirement 

Using words in sentences (writing a sentence that shows 
the meaning of a new vocabulary word) 

Antonyms (words opposite in meaning) 

Figurative Language (recognizing the meaning of a 
word or phrase used in a nonliteral sense, including 
simile, metaphor, and idiomatic expressions) 

"John laughed his head off." 
means "John laughed a lot." 

Crossword Puzzles 

Classification of words (apples, oranges, and peaches 
are fruit). 

Tasks: The student might be asked to give the meaning of a word, 

match a word with its definition, or write a sentence using 
a particular word. 



13.0 COMPREHENSION - Understanding of ideas expressed in written 

material, including understanding of literature 
and understanding of written material in the 
content areas (science and social studies) 

The story below will be referred to in the examples of the comprehension 
categories. Time spent reading the story would, be coded in Reading 
Practice. Time spent answering questions, writing about, or discussing 
the story would be coded in Comprehension. 

SAVING THE SEALS 

Who owns the sea? The ships of all countries sail the open 
seas. Not long ago, all countries could fish and hunt in the 
ocean as they pleased. Now, the countries using the sea must work 
together to protect the sea's animal life. 

In 1870, there were millions of valuable fur seals in the 
Bering Sea. Ships came from all parts of the world to kill them. 
Men wanted the animals' fur and the oil from their bodies. By 
1910, only about 130,000 seals were left. Even the hunters knew 
that something had to be done or the seals would disappear. 
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Four countries owned land near the seals' northern home. 
In 1911, these countries began plans to control seal-hunting. The 
governments of Japan, Russia, Canada, and the United states agreed 
to kill no more seals in the open seas. Because they wanted to 
protect mother seals and their young, they agreed that only male 
seals without mates could be killed. Money earned from the skins 
and oil of these seals was to be divided among the four governments. 

Today, large heards of seals swim in the Bering Sea again. By 
working together, four countries saved the seals in the sea they 
share. 



13-. 1. Verbatim (no rephrasing) 

Understanding and recall of information exactly as stated in the 
text. 

Examples: 1. Where do large herds of seals swim. today? (in 
the Bering Sea) 

2. Which governments agreed to kill no more seals 
in the open sea? (Japan, Russia, Canada, U.S.) 

3. Why did they agree that only male seals without 
mates could be killed? (to protect mother seals 
and their young) 

13.2 Translation (paraphrase) 

Recognizing ideas stated in different words; recall of information 
when ideas are restated; rephrasing of ideas in other words. 

Examples: 1. Which countries joined in the agreement to limit 
seal killing? (Japan, Russia, Canada, U.S.) 
2. Describe in your own words what the countries 
agreed to do. 




13.3 Inference/Synthesis 

Synthesis of information from different points in a text; under- 
standing of ideas implied by a text; using background knowledge or 
experience to interpret or extend the ideas in a text; drawing 
conclusions or predicting outcomes. 

Examples: 1. Why were the seals hunted? 

a. People wanted to eat seal meat. 

b. Their fur and oil were valuable. 

c The seals were eating all the fish. 

2. The story does not say so, but it makes you think 
that 

/ a. hunters used seal oil on their bodies 

* b. seals have little value for hunters 

c. all the seals might have been killed 

3. What would happen if only 2 of the 4 countries 
joiftftd the agreement? £jgjn ' 
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13 *4 Identifying main Ideas 

5E°2i£2 t0Pl ? ° f 8 Pa8Sage5 identif ying and understanding 
the central or most important ideas being communicated. 

Examples: 1. On the whole, this story is about 

a. Russia and Canada 

b. protecting seals 

c hunting in the Bering Sea 

2. What message is the author trying to get across? 
Ut is important to protect animals. Countries 
need to work together.) 

Besides answering questions, this content category 
includes work on outlining a passage, or recognizing 
the structure and organization of a passage (super- 
ordinate and subordinate elements). 

13.5 Evaluation of fact and opinion 

Critical analysis of statements and the basis for their acceptance; 
identifying fact and opinion statements. Also includes evaluation 
»L 1 ic *tions of a speaker/writer and understanding how 

loaded words convey opinions. 

Examples: Which statement is a fact rather than an opinion? 

a. Seals should be protected. 

b. All the seals very nearly died. 

c. In 1910, only about 130,000 seals were left. 

13 • 6 Other comprehension 

Comprehension of written material which does not fit one of the 
specific categories above. Also includes situations where a 
comprehension activity mixes several types of comprehension so 
thoroughly that it would be impossible to separate the time. 

Examples: Following directions 

Application of reading skills to real-world 
materials like signs, -menus, TV schedules 
etc. ' 



14 '°' READING PRACTICE - Practice in reading 

Note: All reading activities involve the act of reading. Use the 
Reading Practice category onl^ for activities where students 
spend time just reading. We will automatically assume that 
time in specific skills (decoding, word structure, word 
meaning, or comprehension) includes some reading practice 
as well. 

™k 253 
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14 . 1. Sight words 

General practice at reading single words. No particular decoding 
• focus. Students must integrate a variety of decoding skills in 
order to read a word on sight. 



Tasks:. Students read these words at the beginning of a lesson: 

slippers bought hurry etc. 

Teacher reads a word and the students must circle it: 

^ watch^ was what 

liver lives ^silver" 

Any word reading task where there is no intent to practice 
specific decoding patterns. 

14.2. Oral -eading of text 

Individual or choral reading of stories by students. 

Tasks: Reading circle where students take turns reading aloud 
from a story. 

14.3. Silent reading of text 

The student reads a story to himself. 

Tasks: Students have time tor independent reading. Each student 
reads to himself. Students might go to the library and 
read. A student might read when he finishes other work 
early. 

14.4. Reading in content areas 

Reading science or social studies material (oral or silent) 

Tasks: The student reads silently in the social studies book. 

. .'_ The ..students tjike turns reading aloud from the Weekly' 

Reader. 

14.5. Listening while reading 

The student list ens while he reads in an accompanying text. 

Tasks: The student must be simultaneously reading and listening. 

He could be listening to a tape or record of a story and 
reading along. Includes music if the student is both 
reading and singing. 
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15.0. 



READING RELATED — SPELLING - matching word sounds with 

particular configurations of letters 

Tasks: The teacher might read a word or sentence and have the 

students write it. Students might have to decide whether 
or not a word is spelled correctly. Includes work on 
homonyms (like "to", "too", "two", or "peace", "piece") 
and their correct use in sentences. Some lessons may focus 
on particular patterns in letter-sound correspondence 
(like sounds of the letter "y", or words with silent "e"). 



16.0. READING RELATED - GRAMMAR ~ understanding sentence structure 

and grammatical form. 

Examples: Capitalization, punctuation, parts of speech, diagramming 
sentences 

Tasks: Many possible activities Involving grammatical concepts. 



17.0. READING RELATED - CREATIVE WRITING - students make up their 

own stories and write them. 

Tasks: The teacher might have all students write a story about summer 
vacation. Or students might write their own endings to a 
story they have been reading. 

18.0. READING RELATED — OTHER 

18.1. Study skills 

Learning and using skills that help the student acquire knowledge 
through reading. • 

Examples: Dictionary skills, alphabetization, table of contents, 
using the index, using the encyclopedia, card catalog, finding 
books in the library. 

18.2. Other 

Other activities which are related to reading. 

Examples: Foreign language. 

Reading maps or graphs. 
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19 «°- READING , BELOW TEST LEVEL — copying or imitating 



Examples: Copying, where the student directly copies letters, 
jrords or sentences. Includes penmarship. 
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CONTEXT CLUES — A COMMON FORMAT 

A common response format in workbook pages, especially in earlier 

?I n!rfn™ £ *l ^V^T t0 fil1 in the blank to complete a sentence. 
To perform the task the student must read the sentence parts .hat are 
given and understand their meaning in order to recognize the element that 
would complete the thought. He must use the context as a set of clues 

XSLSS^I- natu " '°5 the missin 8 P iece - Understanding the sentence 
framework is a comprehension process. But the task also involves selecting 
the best word (s) to fill the blank, and the nature of the choices is 

To code the content of items in a context c l ues format, consider 

the distinctions the chi ld must make in order to selec t trhp rnr^ 1 

alternative . " — 

The examples below show some of the different ways a context 
^/ clues format can be used: 

Decoding ; 

Jane ate a red candy 

cane/can 

Here the student must not only understand the sentence but 
also know the role of final e in decoding vowels. Without 
this knowledge of decoding patterns, the child might know the 
word he wants to fill the blank but still select the wrong 
alternative. The purpose of the exercise is to practice 
decoding rules. 

Word Structure : 

Tim went down the street 

skip 

skips 

skipping 

This exercise teaches correct use of grammatical endings. 
Word Meaning ; 

Susan ran to her house. Then _^ went inside. 

s she 

he 
it 

This requires pronoun reference. 

Some animals have snouts. They are really long 



ears 

mouths 

noses 
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Because the ocean roars, we need to to be heard, 

talk 

shout 

whisper 

In the two examples above, the emphasis is on the meaning of the missing 
word. The student must consider the semantic distinctions among the choices 
in order to select the word with the best meaning to complete the sentence. 

Choose from these words to complete the sentence below: 

lazy dozing buzzed dizzy grazing 

Soon, a bee around the colt's head. 

In this example the word choices all have the letter "z". But this 
decoding element is a constant factor; students don't have to focus on the 
decoding in order to complete the sentence. Sentence completion focuses 
on selecting the word with the best meaning. (Note: Time spent reading 
the word choices and talking about the sound of the letter "z" in these 
words would be coded as Decoding. 



Comprehension ; 

After reading the story of the Little Red Hen, the student must 
complete this sentence: 

The fox lived in a house made of . 

straw 

wood 

stones 

The purpose of questions like this is to check story comprehension; the 
correct answer depends on having read the story. This question assesses 
understanding of event data (verbatim). 
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2.12. M ath Content Category Summary 



20. ADDITION/SUBTRACTION (NO REGROUPING) 

- standard short form 

- basic facts 

- speed tests „ 

21. ADDITION/SUBTRACTION (WITH REGROUPING) 

- standard short form 

- basic facts 

- speed tests 

22. COMPUTATIONAL TRANSFER (Properties, // patterns, missing addends 

number sentences with inequalities) 

23. PLACE VALUE/NUMERALS (whole numbers) ^ ! 

i 

24. MULTIPLICATION 

- basic facts 

- speed test 

- multiplication algorithm 

25. DIVISION 

- basic facts 

- speed test 

- division algorithm 

26. FRACTIONS /DECIMALS 



27. SPATIAL APPLICATION 

- linear measurement 

- geometry (perimeter, area, // pairs, lines /figures) 




28. VERBAL APPLICATION 
- word problems 

29. MATH RELATED 

30. MATH BELOW TEST LEVEL 
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Math Content Category Definitions 

20. ADDITION/SUBTRACTION—NO REGROUPING 

Learning the basic addition and subtraction facts. Finding the sum 
or difference of problems which do not require the renaming of 10 
ones as 1 ten or 1 ten as 10 ones (i.e., no "carrying 1 ? or "borrowing") 

20.1 Basic facts: Basic addition facts are c"he sums of two single digit 
addends up through 9+9. The basic subtraction facts are the 
inverses of the addition facts and therefore include facts .up through 
. 18—9. < 



20.2 Non-regrouping problems in addition: Sums of a single digit and a 
multiple digit addend or two or more multiple digit addends which 
do not require the renaming of 10 ones as 1 ten. 



m 



10 23 547 

+ 5 + 46 + 201 

* 

Includes cojlumn addition without regrouping. 

6 20 21 • "* 

4 30 13 

+ 5 + 10 + 15 \ 

20.3 Non-regrouping problmes in subtraction: Finding the difference 

between a single digit and a multiple digit number or the difference 
between two multiple digit numbers which do not require the renaming 
of 1 ten as 10 ones. » 

27 28 532 

r 7 - 14 - 420 

Note: Problems in this category can be presented in a variety of 
formats. 

The problem may be laid out horizontally or vertically: 

2 3 
+ 3 -2 2 + 3= 3-2=' 
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Pictoral representation may be usad to. help the students understand 
the basic processes of joining or separating sets and/or as an aid 
in carrying out the computation involved: 




0 1 2 3 U 5 



2+ 3 



3 - 2 



■In all of the examples above, the primary task is to find the sum or 
difference between two numbers when both of those numbers as well as 
the applicable operational sign are given. 

However, there are situations where instructional algorithms or 
processes, involving place value concepts are used in the teaching 
of these same computational skills and when this occurs the instruction 
should be coded under category #23. 

There are other situation^ which require more than the straight- 
forward computation of a sum of difference (but do not involve place 
value) and these situations are discussed in the Computational Transfer 



ADDITION/ SUBTRACTION — REGROUPING 

Addition problems which require the renaming of 10 ones as 1 ten ("carrvinK") 
and subtraction problems which require the renaming of 1 ten as 10 ones 
( borrowing ). Here we want to include only the regrouping problems which 
are presented in the standard computational algorithmic format, also 
known as the short form. 



27 + 3 - 



18 


13 


26 


40 


+ 14 


15 


- 9 


- 15 


32 


+ 16 


17 


25 
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This category is parallel to category 20 in that the student is given 
two numbers and told to find their sum or difference but in this case 
the problems also require regrouping. The general guidelines on format 
in category //20 also apply to this category . 



COMPUTATIONAL TRANSFER 

Tasks which require the student to recognize and apply some of the 
operational concepts and patterns within our number system. The 
student must understand and use the operations which underlie computation, 
but in a format which involves more than straight-forward computation. 
Includes: 
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22.1 Properties ; 

1. Commutative property of addition and multiplication. 

3 + 2=2+3 
2x3*3x2 

2. Associative (grouping) property of addition. 

2 + (3+5) = (2+3) + 5 

3. Properties of zero. 

Identity element of addition: 18 + 0 = 18 

4. Distributive property. 

2 x (3+2) « (2x3) + (2x2) 
(12+6) * 3 = (12*3) + (6*3) 

4 . 

22.2 Number Patterns: Tasks which promote the student's search for and 
recognition of the various patterns which can be found among numbers. 

Examples: 



1, 
2. 
3. 



Counting by 2*s (odd and even numbers). 
Counting by 5*s, 10*s, 20*s, etc. 

Functions - discovering or applying a function rule like. add 3, 
subtract 2, etc. 

Rule is given: Add 4 to each number in top row: 



0 


2 


5 


7 


9 


4 


6 









Stydent must discover and apply the rule to complete the pattern. 



1 


3 


8 


4 


4 


6 


11 


? 



7 » 5, 3,_2__ 
{ (1,2), (2,4), (3,6), (4,?) } 
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22.3 Missing Addends - Open Sentences: Number sentences in which the 
sura or difference is given and one of the addends or numbers is 
unknown. 



Examples : 



□ - 5-5 

+ 3 +Q 5 -□- 2 



□ 
- 3 



7 I I + 6 » 10 

" □ 4+| 1-10 



22,4 Number Sentences with Equalities and Inequalities - Includes only 
those number sentences that involve computation plus the use of 
>. <. -,+,-. 

7-6©l+3 7^2-5 
7Q4-3 

10 -10 © 15 + 5 8 3 " 11 % 

This category does not include the use of inequality signs in numerical 
comparisons, i.e., 



27© 26 
127 0126 



This should be coded as #23 (place value/numerals) 



22.5 Factors and Multiples; The study of common and least common multiples, 
common factors, sets of factors, prime numbers, and prime factorization. 

Examples: 

1. 6 « 42 2, 12 = 2x2x3 

3. Name the multiples of 2, less than 20. 



9 

ERIC 



263 



38 



23. PLACE VALUE /NUMERALS 



23.1 



Place Val ue/Numerals - Place value Involves the concept that a digit 
has three meanings. It's face value (the meaning it has wherever it 
is used), it's place value (the meaning it takes from it's place in 
a numeral), and it's total value (which is the product of the first 
two values). In the numeral 45, tne 4 has a face value of four, a 
place value of ten, and a total value of forty. Teaching place value 
will involve expanded and compact notation, identification of the 
one's, ten's, or hundred's place, and naming the number of tens (or 
ones, etc.) in a numeral. 

.Numerals includes understanding the order of the counting numbers and 
evaluating the sequential position of one numeral in relation to 
another. Comparing and evaluating numerals will involve place value 
concepts. 

Examples: 

A. Place Value: 



1. 
2. 
3. 
4. 
5. 



How many tens in 75? 
Which number is in the one's place? 
6 tens and 1 ones ■ 60 + 2 ■ 62 
155 "100+50+5 

Use of manipulatives or pictures to teach numerical structures, 































































































































- 






































_ 








- 


J 



_2 hundreds, 
We write 234 



3 tens, and 



B. Numerals 



1. Writing the missing numerals. 



46 



49 



2. 
3. 
4. 
5. 



What number comes before, after, or between? 
Using inequalities .: 145 > 135. 

Practice in reading numerals up through millions. 
Understanding the use of commas to set off the periods (e.e 
1,575,231). h ' 
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23,2 ^ dltlQn/Subt:ract:lon Wlth °r Without Regrouping - Instru ctional 
Algorithms With Place Value Transformations ! 

In our base 10 number system the understanding of place value is 
essential to the learning of computational skills. With this in mind 

wh^h T/ ate y lalS °f ten lnclUde inst ™ctional algorithms or processes 
which combine place value concepts along with practice in computation. 
These processes may involve expanded notation or the designation of 
tens and ones. Some common (depending on text) instructional algorithms 



14 
14 



10 + 4 
10+4 

20 + 8 = 28 



(Use of Expanded Notation) 



16 
+ 14 



Tens Ones 



1 
1 



6 
4 



(Designation of ten's and one's place) 



14 
+ 14 
8 

20 

28 



(Long form with partial addends) 



24. MULTIPLICATION 



24,1 Multiplication - Basic Facts ; Multiplication with two 1-digit factors. 
Also known as times table up through 9x9. 



24,2 Multiplication - Speed Tests : Timed tests in the basic multiplication 
facts. May also include speeded flash card drill which is specifically 
aimed at increasing automaticity. 



24,3 Multiplication Algorithm: Multiplication with one factor of two or 
more digits, i.e., all multiplication above the basic facts. 



25. DIVISION 



25.1 Division : Division of whole numbers . All levels of difficulty. Includ 
speed tests in division. 



es 
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26. FRACTIONS /DECIMALS 



26,1 feg?on? n or "line? 8nl2ln8 ^ identlf y ln 8 a Pactional part 



Examples: 



a. 






part of a set, 



Draw a ring around 1/3 of 
the trees. 



b. 




What part of this region 
is shaded? 



26 ' 2 T5SrffllationT tati r r lth ^ a " i0nS inCludin * the "cognition and 
identification of equivalent fractions. 

26.3 Fractions ; Converting decimals into fractions (e.g., .625 = 5/8) 

26.4 Decimals ; Place value ( ^0 - .01, .5 > .25); arithemtic operations 
with decimals (+, x, *). 



27. SPATIAL APPLICATION 



27.1 Linear Measurement - Measuring the length, width, or height of 
objects, lines, or pictures. 

27.2 Geometry - Perimeter; Computing the perimeter of a polygon using 
standard or arbitrary units of measure. 

Ar-ea- ; - -Computing- ttiraferora polygon using standard 
or arbitrary units of measure. 

27.4 Geometry - Number Pairs; Identifying number pairs on a number plane. 
Example: 











p 
















— < 


a. 






p. 

















12 3 4 5 6 



What is the number pair for point Q? 
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27.5 Geometry - Lines or Figures ; 

Recognizing and identifying common lines and plane figures. Includes 
angles, parallel and perpendicular lines, parallelograms, rectangles, 
squares, and right triangles. Does not include work with solid 
figures like spheres, rectangular prisms, etc. 



28. VERBAL APPLICATION 



28.1 Word Problems; All types of word problems including word problems 

with graphs. The coding of word problems is given priority over the 
.specific computation required by the problems. Therefore, regardless 
of the computation, time on word problems is coded under word problems. 



29. MATH RELATED 



29.1 Money, - Identifying coins, the sura of a set of coins, and equivalent 
values of coins. 



29.2 Other Concepts; Other concepts and applications not covered bv codes 
20 through 28. y 



Examples: 



Basurcls 



Volume 

Solid Figures 
Liquid or Weight Measures 
Statistics and Probability 
Constructing Line and /Bar Graphs 
Set Theory, Set Diagrams, Logic 
Exponents (concepts of) 
Averages (concepts of) 



30. MATH BELOW TEST LEVEL 



30.1 Developmental Activities - Activities which do not involve computation 
but do promote the development of concepts which are considered 
preliminary to the understanding and use of operational concepts. 
Includes! 

A. Review of baric number concepts such as learning the number name 
for a set of objects less than 10, learning to count and write 
the numbers from 0 to 10, one to one matching and recognition 
of equivalent sets. 
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Examples: 




three 



How many? 



Activities which provide experiences (most often with concrete 
materials) in recognizing: likenesses and differences, sorting, 
ordering, comparing, and matching. 

Examples: Attribute blocks or games 
Pattern blocks 
Tangrams 
Geoboards 
Geoblocks 
Soma cube puzzle 



2G8 



2.13. Content Summary; Other Academic 



40. PHYSICAL/BIOLOGICAL SCIENCES 

- Biology 

- Physics 

- Chemistry 

41. SOCIAL SCIENCES 

- Geography 

- History 

- Social Studies 

- Current Events 



42. FOREIGN LANGUAGE 

- Spanish 

- German 

- French 

- etc. 
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Other Academic Content Category Definitions 

40. PHYSICAL/BIOLOGICAL SCIENCES— An activity primarily involved with knowing 
about matter, energy, plants and animals. 

Examples:, a. Physics, chemistry, geology, anatomy, meteorology, 
biology, astronomy. 



41. SOCIAL ^IENCES--An activity primarily concerned with humans and their 
living together. 

Examples: a. Social Studies, 

b. Geography (human), 

c. Sociology, pyschology, 

d. Current events, government, politics, . 

e. History, 

f . Economics, 

g. Political science, law, 

h. Anthropology, 
j. Art history. 



42. FOREIGN LANGUAGE — An activity primarily involved with reading, writing, 
or conversing in other than the native tongue. 

Examples: a. Spanish, 

b. French, 

c. Russian, 

d. Latin, 

e. Turkish, 

f . Hebrew . . . 



Note: If any math or reading is involved in these other academic 

activities, be sure to code the specific math or reading category 
in addition tp the other academic category. 
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APPENDIX D 
SAMPLE TEACHER PRINTOUT & DIRECTIONS 



Dear 

Your individual inservice conference is scheduled with _ 



° n >' > at — : • He will meet you at your classroom. The 

conference should take between a half hour and 45 minutes. 

Before your conference, please be sure to study the enclosed materials: 

1) Teacher's Manuals Teaching Strategies for Increasing Academic Learning' 1 
Time and Student Achievement, s 

2) Directions on interpreting the individual observational summary printouts. 

3) Computer printouts summarizing baseline observations of you and your 
target student(s). There" is one printout for each student observed. Write down 
any questions you have about these materials for "the conference. 

Thank you. See you at our conference. 

» 
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INTERPRETING THE INDIVIDUAL 
TEACHER OBSERVATIONAL DATA SUMMARIES 



Introduction 



(TS) £l I? l Provided with one data summary per target student 

fori? ?,° r H ! ^ aCheS * Each data au ™ arv contai ns descriptive in- 

formation collected by an observer coding on the Academic Learning ?,-, I 

ob b :e e rv"\"ns S o y r e v: u (AL J 0S) - EaCh ^ contalnTinfo^J 2.* m 

provided on%h! ^ /T studet ^ onl y- The data summary is 

f e ° a T K SGd f °? r -P a 8 e computer. printout(s). The first page 
lists the dates of observation, teacher ID numbers and number of educa- 

eris 3 till VT H° bSerVed eaCh day< ^ Second P^ e ~L« c- 
g ud nt .cSjvi Cities such as pacing, predominate tar- 

get student activities, task success, instructor activities, etc. The 
third page summarizes the subject matter areas observed. Final ly the 
fourth- page summarizes observed student engagement, non-engagemln 
be y h P a e :io°rs" StrUCt ° r T' " d se ^cted combinations of student -teacher 

PRINTOUT PAG E 1: Dates of Observation 

DATE: Refers to the dates on which ALTOS observations occurred. 

TEACHER ID: Identification number of the teacher observed on each 
date. Inmost cases this will be your teacher ID number, unless a sub- 
st ute or student' teacher W as observed in your classroom that day. 

that^yf 011 " 111 ' 82 NUmber ° f educati °-l activities observed and coded 



PRINTOUT PAGE 2: Educational Activity Sundry 

M . n Th V° p part of th ! s P a 8e provides general identification informa- 
tion and the rest provides descriptive information on education" 
activity characteristics. onai ; 

fTO " UDE |; T ID /. Identification number assigned to the target student 
(TS) to whom this printout summary refers. 

STUDENT NAME. First name and initial of TS ' s last name. 

TEACHER ID: Your assigned ID number. 

SCHOOL: School name or abbreviation. 

NO. OF DAYS OBSERVED: Days on which you were observed with the TS . 

TS wa's'ob" AC T™ S OBSERVED: Total number of educational activities 
Jctlv tv 11* f< aS teaCher * Note that « educational 

1 ^ *" *• ^ -«« « ***** 

i 



TOTAL TIME OBSERVED: In minutes. 
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darin^f' ^ AVe " 8e ° f StUdentS P reSent » 7°"' class 

during observations,.. 

> 

■AVERAGE NO. OF STUDENTS IN SAME ACTIVITY: Doing exactly the same 
activity as the target student (TS). 

r.n F r/ aCl J ° f followin 8 categories, four kinds of summary data are 
reported: frequency, percent frequency, time and percent time. 1) Fre- 

fST* mostt TJir "J"*™"".** ^ich the category was predominate 
(e.g., mostly self-paced mostly discussing, etc.). 2) Percent frequency 
is the frequency multiplied by 100 and divided by the t otal number of 
activities observed 3) Time is the total time in minutes that the cat- 
egory was observed (by summing the durations of the activities in which 
100 r.T r T J red u ° minate) ' 4) Percent time is the time multiplied by 

to 100 f V 7 ^ t0 ' al time * N ° te that the Percentages may not add 

to 100 for a given classification (e.g., TS PACING) due to occasional 
missing data* 

TS PACING: Coded as SELF-PACED if the target student worked mostly 

If thl llMl °T,l aCe dUr - ng the activit y < e 'S'> independent seatwork). 
If the pacing of the activity was mostly determined by someone or some- 
work). ^ C ° ded 38 0THER - pACED < e '8'. typically >this is group 

TS ACTIVITY: Coded as ORAL READING, SILENT READING RECfTTNr 
LISTENING , DI8C0S8IW. WRITING or OTHER depending on „hic^ a egorv was 
predominate during the activity observed. category was 

V 

r.1 Jff S ? CCESS IN R ? ADING: C ° ded aS HIGH « ^IUM or LOW in reading 
related activities only. HIGH TASK SUCCESS refers to few or no target 
student errors on the task(s) required by the- activity (i.e., TS mas- 
"I' d T\T? Well) * L0W TASK SlJCGESS refers to almost all TS errors 

Sm taIk sue e s II ? mal : e % n ,° attemp ^ at task(s) or just 8uess -« 

TASK SUCCESS! performance which is not HIGH or LOW 

only T tn K ma S th? ESS ™ *™ S Cate8 ° ries as for r -ding activities, 

.^ASK SUCCESS TOTAL: Same categories as above , but results are given 
for all activities in which task success was coded, regardless of sub- 
ject matter. 

INSTRUCTOR: Predominate source of instruction of the target student 
during the activity (TEACHER, PEER TUTOR , ADULT AIDE , SE LF- INSTRUCTIONAr ' 
MATERIALS , TEACHING MACHINE , or NO INSTRUCTOR) . Moti that NO INSTRUCTOR 
was coded only if there was no direct interaction with the target stu- 
dent during the entire activity by any of the other sources. 

INSTRUCTOR ACTIVITY: Predominate instructor behavior during the 
activity. Coded as LECTURING, DISCUSSING, PROMPTING, MODELING/ DEMON- 
STRATING, TESTING, SUPERVISING or OTHER. 
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PRINTOUT PAGE 3j Activ ity Subject Matter Summary 

^o? e - Pre S! 0 T inant: C ° ntent area of the ^tivity was coded by one of the 
Zrt g o£ 11 l0W< N ° te that if mUltiple C ° ntent areas were observed a 

. mIth-^lIted 8 ::: c ^ed v : ty in reading or raath « or 

READING: Coded as DECODING/PHONICS, WORD STRUCTURE WORD WraiTtmp 
COMPREHENSION, READING PRACTICE, SPELLING , GRAMMAR ,COMPC SIT ION/ WR ITINP 
READING RELATED-OTHER or READING BELOW TEST LEVEL. C ° MPCSITI0N/WRITING » 

MATH: Coded as ADDITION/SUBTRACTION— NO REGROUPING ADDITION /<?riR- 
MmJro??;;? ITH REGR0UPING » COMPUTATIONAL TRANSFER, PLACE VALUE /NUMERALS 
MULTIPLICATION, DIVISION, FRACTIONS /DECIMALS , SPATIAL APPLICATION WORn ' 
PROBLEMS, MATH RELATED-OTHER or MATH BELOW TEST LEVEL. * W0RD 

LANgSIgE R ACADEMIC: C ° ded 38 SCIEN CE, SOCIAL STUDIES or FOREIGN 

NON-AGADEMIC: Coded as ART, MUSIC, TECHNOLOGICAL ARTS PHYSTPat rnri 
CATION, PERCEPTUAL DEVELOPMENT, MANAGEMENT/ PROCEDURAL ' ™~ 

BREAK, PERSONAL EXPERIENCES or OTHER. ' ™ U ^ UURAL > RECREATION/ 

and NON-AC^ffc^ 18 * U ° ^ *°\ READING » MA ™' ° THER ACADEMIC 

PRINTOUT PAGE A; Target Student and I^ructor Summarjr 

At one minute intervals during a reading or math activity the obspr- 
ver coded the target student behavior, instructor move! and focus of the 
move occurring at that moment. Three kinds of data are reported' time 
percent time and time ner dav n ri ma k u r eporcea. time, 

ate in^pr« a i 0 V 1 • u u V ' ' -- me refers t0 the number of on- min- 
ute interval in which each category was observed. This is an estimate * 
of the amount of time in minutes spent in that category. 2) ?ercen time 

■ observed in" ILTZ^ ~ l £ ipli ! d . b ? 100 and d " id * d by the Iota! 4 
observed n reading or math activity 3) Time per da v should be ig- 
nored, unless you have been observed i Jt full days. 8 

LEARNER MOVE S (target student only) 

ENGAGED WRITTEN: TS is overtly and non-oral ty attending to the sub- 
_f£~£S of a reading or math task (e.g., writing, manipulating objpctf" 
using calculator, typing on computer). S ° DjRCCs > 

a reaTXth A ta S k S ( iS 3Ctend ^ t0 the substance of 

a reading/math task (e.g., asking or answering question, c omm^nlinT'" 
presenting oral report, reading aloud). commenting, 

ENGAGED COVERT: TS n covertly attending to the substance of a read- 
ing/math task (e.g., listening, watching, "thinking"). 
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ENGAGED WITH DIRECTIONS : TS is attending to the structure (goals) or 
directions of a math/reading task (mode of engagement not coded--e. g 
listening, to directions or reading directions are both coded the same). 

with T di^ecaons ER ENGAGEMENT: Sum of en **& ed ^ten, oral, covert and 

t i 0 „?° T f EMGAGE ?/ INTE !f M! TS iS n0t attendin 8 ^ ^e substance or direc- 
tasl(l * T " taS! '' bUt iS d ° ing ^hing peripheral to that 

needed)! SharpetUng penCli ' P assin 8 in Papers , finding supplies 

NOT ENGAGED WAIT: TS is not attending to the substance or directions 
of a math/reading task because s/he is -aiting on someone or somet ung 
else in order to continue the task (e.g . hand raised for teacher help, 
standing in line to get paper graded, interruption of class by special 
announcement on intercom). 7 s P eciai 

NOT ENGAGED OFF-TASK: TS is not attending to the substance or direc- 
tions of a math/reading task nor not engaged interim, nor not engaged 
wait e.g., talking to neighbor, arguing, fighting, daydreaming, staring 
out window, sleeping, wandering around room). 8 ' SCaring 

off-tas^ UARMER N ° N - ENGAGEMENT ^ Sum of not engaged interim, wait and 

INSTRUCTOR MOVES ( usually teacher, but could be peer, etc.) 

NON-DIRECT INSTRUCTION: Instructor is not directly interacting with 

^ nllt^T " S ° me0ne 6186 in 3 8r ° Up activit7 which includes 
TS. Note that the instructor could be working with students in another 

ing° U sea a twor^ y ^ TS ' ° ther -dividuaTs^uT- 

ACADEMIC MONITORING: Instructor is directly observing how well TS 
(or someone else in the group including TS ) is doing on a reading/math 
task but makes no other remarks (e.g., teacher looks over students 
shoulder as s/he works, watches students work problems on board, listens 
to oral book report).' ' iiscens 

ACADEMIC FEEDBACK: Instructor informs TS or group including TS 
whether a student reading/math response is correct or incorrect? No ad- 
ditional explanation is provided (e.g., "That's right.", "No.", TS looks 
at instructor marks on test or worksheet, another student or the in- 
structor reads aloud while TS reads the same text silently.) 

ACADEMIC QUESTION : Instructor solicits a reading/math related re- 
•ponse from TS or another student in the groap which inc 1 udes TS (e^g. 

3 plus 5 equals?", "What is the capital of Indiana?", "Summarize the 
resp^rr ^ St0ry • , ' , inStrUGtor sh0 ™ ^ card and I ill or a 
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EXPLANATION BASED ON STUDENT NEED: Instructor provides a statement 
concerning the substance of a math/reading tasks because one or nore 
students are having difficulty or need immediate assistance. Statement 
xs not about structure or directions of task (e.g., "The reason your 

TrlTJ™ I" th3 ' 1 tHink y ° U f0r80t t0 borrow when you sub- 

tracted. The word 'anticipate' means ... (in response to student 
question) , Everybody, listen. A number of you are having difficulty 
wxth these problems because you are not placing your decimal points in 
the r lg ht places Remember, when you multiply decimals, the answer must 
have as many digits to the right of the decimal ..."). 



PLANNED EXPLANATION: Instructor provides a statement concerning the 
substance of a reading/math task. Statement is not about directions to 
or structure of task, nor in response to an immediate student need^or 
dif* culty with the task (e.g., lecturing, modeling, demonstrating, 
etc.;. No student response is expected, other than attending to the 
explanation, B ,e 

STRUCTURING /DIRECTING: Instructor structures or gives directions for 
a math/reading task. Does not involve the substance^f the task itseU 
^e.g., Do the first 5 problems on page 22 in your math book.", "The 
reason we re doing this activity is so you will know if you receive the 
correct amount of change when you pay for something at the store."). 

TASK ENGAGEMENT FEEDBACK: Instructor comments on student engagement 
or non-engagement, but not about the substance or directions of fread- 

atl^H * Sk ,^ e : 8 " 1 m , 8l3d t0 SGe y° U ' re Workin 8 «o hard.", "Pay 
attention.", "Quiet get back to work etc.). 

TOTAL DIRECT INSTRUCTION: Sum of academic monitoring, feedback 
questioning, explanation based on need, planned explanation, struc- 
turing/directing and task engagement feedback. 

FOCUS OF INSTRUCTOR MOVE 
targeTstud" 1 ' '""^^ "° Ve " dire " ed 'P«»icall y to the ' 



GROUP: 
student in 



Instructor move is directed to someone other than the target 
the group which includes TS , or to the group as a whole. 



JOINT LEARNER X INSTRUCTOR MOVES 



t TS ENGAGEMENT DURING NON-DIRECT INSTRUCTION: No direct instruction 
is being provided to TS or someone in a group which includes TS and TS 
is engaged m the reading/math task (written, oral, covert or with"" 
direc tions ) . 

_ TS NON -ENGAGEMENT DURING NON-DIRECT INSTRUCTION: No direct' instruc- 
tion is being provided to TS or someone in a group which includes TS 
and TS is not engaged ln the reading/math task (interim, wait or 
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prov^d N ?o G ?s ME " T DURING DIRECT INSTRUCTI0N: direct instruction is being 
provided to TS or someone in a group which includes TS (e.g., academic 
feedback, questioning, etc . ) , and TS is engaged in the read § ing/Llh 

TS NON -ENGAGEMENT DURING DIRECT INSTRUCTION: Direct instruction is 
being provided to TS or someone in a group which inc ludes TS ^ and TS if 
not engaged in the reading /math task. ' — 

IMPORTANT INSTRUCTOR MOVES 

cificaflTto thf ? ACK 1° ?!> Ins « u "» is S«in 8 academic feedback spe- 
cincaiiy to the target student. F 

to ao^one'ellfr^ 10 ^ .'""""P" is H™»« academic feedback 
as a^hole. 8r ° UP aCtlvlt ' r ^ incl " d " «. or to the group 

PLANNED EXPLANATION TO GROUP: Instructor is giving a planned exnla- 



or 
c 



r st™turLT^e R taIk N f " ^ l™"""™ l « ^ Vidi "« di "«-"^ 

^udes ru Ts c : r or^o th the a :rou f p r a:T: h n o^:^ se in the ^ 
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ACADEMIC LEARNING TIME TEACHER DATA SJWAU ?MD SE1ESTE* 1982-93 
DATES O e OBSERVATION! 



date: 


FEB 


15, 


1993 


TEACHER 


id : 


* '4 0 


NO. 


ACTIVITIES: 


2 


date: 


FEB 


17t 


1993 


TEACHER 


ID : 


MO 


NO. 


activities: 


2 


date: 


FEB 


21, 


199 3 


TEACHER 


I'D : 


4 '4 0 


NO. 


ACTIVITIES: 


? 


date: 


FEB 


2<»» 


1983 


TEACHER 


id: 


4 '4 0 


NO. 


activities: 


? 


date: 


FEB 


28* 


1993 


TEACHER 


id : 


440 


NO. 


activities: 


}> 


date: 


MAR 


3, 


19B3 


TEACHER 


id : 


4 40 


NO. 


activities: 


3 


date: 


MAR 


10* 


198 3 


TEACHER 


id : 


* *o 


NO. 


activities: 


1 



9 
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ACADEMIC LEARNING THE - TEACHER OATA SJUm - ? N 3 S^ESIE, 



TEACHER ID: %w 



STUDENT ID! 05 STUDENT NAME: IKE : 

school: ellettsvl. mo. of DA rs observed: 7 

ACTIVITIES OBSERVED! 15 TOTAL TIME OBSERVED (MN«)2 3*0 
AVERAGE CLASS SIZr : 13 . 5 AVERAGE ,0. OF STUDENTS IN SAME ACTIVITY* 



13.5 



EDUCATIONAL ACTIVITY SJMMARY 



TS pacing: 
ts pacing: 

ts activity: 



TS ACT 
TS ACT 
TS ACT 



VITY ! 

vity: 
vity: 



ts activity: 
ts activity: 
ts activity: 

task success 
task success 
task success 



SEL r -PACED 
OTHER-PACED 

w ,ORAL READING 
SILEMT R E A D I M r, 

RECITING 
LISTEMING 
DISCUSSING 

WRITING 
OTHER 



reading: 
reading; 

reading: 



IJSK SUCCESS *<ath: 

t??5 success math: 
task sjccess ^ a th : 

task success total: 

TASK SUCCESS TOTAL 
TASK SUCCESS TOTAL- 



HIGH 
MEDIUM 
LOW 

HIGH 
MEDIUM 
LOW 

HIGH 
MEDIUM 
LOW 



♦ INSTRUCTOR: 
INSTRUCTOR : 

instructor: 
instructor : 



TEACHER 
PEER T J T OR 
„ ADULT AIDE 
SELF- INSTR • MAT. 



INSTRUCTOR • '"SB 1 ?? MACHINE 
INSTRUCTOR: NO INSTRUCTOR 



INST. 
INST, 
INST. 
INST. 
INST. 
INST. 
INST. 



activity: 
activity: 
activity: 
activity: 
activity: 
activity? 
activity: 



LECTURING 
DISCJSSING 
PROMPTING 
MODEL /D r MO 
TESTING 
SUPERVISING 
OTHER 



FREQUENCY 
( NO. ) 



6.3 
9.3 

1.3 
3.0 
0.3 
7.3 
0.3 
3.3 
1.3 

5.3 
3.3 
1.0 

0.3 
0.3 
0.3 

7.3 
3.3 
1.3 

15.3 
0.3 
0.3 
0. 0 

.0.3 
0.3 

1.3 
0.3 
P. 3 
0.3 
0.3 
6.3 
0.3 



PERCENT 
FREQUENCY 



40.0 
60 .0 

6.7 
20.0 

0.0 
4S.7 

0.0 
20.0 

6.7 

33.5 
2 0.0 
. 6.7 

0.0 
0.0 
0.0 

46.7 
20.0 
6.7 

100.0 
0,0 
0.0 
0.0 
0.0 
0.0 

6.7 
0.0 

5 3.3 
0.0 
0.0 

40.0 
0.0 



TKE 
CMIN.S) 



121.0 
239.0 

2.0 
35.0 

3.3 
1 S3 .0 

3.3 
45.0 
33.0 



143 
S3 
IS 



3 

0 
0 



3.3 

3.0 
3.0 

159.0 
6 3.0 
5 . 3 



1 



3 3 3 .3 
3.0 
3-0 
0 . 0 
3.3 
3.3 

13.0 

2 0 S . 0 
3.3 
3.3 

111.0 
3.3 



PERCENT 
TIME 



3 6.7 
63.3 

0.6 
25.8 

0.0 
48.5 

0.0 
13.6 
11.5 

42.4 
20.6 
4.8 

0.0 
0.0 
0.0 

49.2 
20.6 
4.8 

10 3.0 
0.0 
0.0 
0.0 
0.0 
0.0 

3.9 

0.0 

6?;4 

0.0 
0.0 
33.6 
0.0 
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ACADEMIC LEARNING TIME -- TEACHER DATA SJMMARf - 



- 2ND SEMESTER 19B2-P3 



ACTIVITY SJRJECT MATTER S J M vj A ^ Y 



heading: 
reading: 
reading: 
reading: 
reading: 
reading: 
reading: 
reading: 
reading: 
reading: 



DECODING/PHONICS 
WORD STRUCTURE 
WORD MEANING 
COMPREHENSION 
READING .=>RACTICF 
SPELLING 
„ , GRAMMAR 
CC^OSITION/tfRITlNG 
RDG. RELATED- OTHER 
RDG. BELOW TEST LVL 

tota1 reading 

math: add/subtract-no rfsrp. 
math: add/su*tkact-w/ r^rp. 

computational transfer 
math: place value/numerals 
Jath: multiplication 

"In. DIVISION! 

math. spatial application 

word prorlems 
math: math related - othfr 
math: math relow test level 

total math 

other academic: science 
other academic: social stud, 
other academic: foreign lan! 

total other academic 



non-academic: 
non-academic: 
non-academic: 
non-acaoemic: 
non-academic? 
non-academic: 
n:)n-academic: 
n'jn-academic: 
non-academic: 



art 
m js i r 

JECHNOL0S. ART 
PHYSICAL mc. 
PERCEPTUAL DEV 
MA\JA5"T/PRDC0. 
RECREAT ION/3RK 
PERSONAL r K3t-^ 
OTHER 



TOTAL NON-ACADEMIC 



FRE3 JENCy 
( NO. ) 



2.0 

0. 3 

1. ) 

1.3 
5.0 
0.3 
0.3 
0.3 
4.3 
0.3 

13.3 

n o 

0.3 
0.3 
0.0 
0.3 
0.3 
0.3 
0.3 
0.3 
0.3 
0.3 

0.0 

0.3 
0.3 
0.3 

0.3 

0.3 
0.3 
0.3 
0.3 
0.3 
0.3 „ 
0. 3 
0. 3 
2. 3 

2.3 



3 ERCiMT 
FREQUENCY 



13.3 
0.0 
S.7 
6.7 

33.3 
0.0 
0.0 
0.0 

26.7 
• 0.0 

B6.7 

0 • 0 
0.3 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0*0 

0.0 

0.0 
0.0 
0.0 

0.0 

0.0 
0.0 
0.0 
0.0 
0.0 

o.o 

0.0 

n.o 

13.3 
13.3 



THE 
< M I V . S ) 



20.0 
0.0 

n.o 

55.3 
124.0 
3.3 
0.0 
3.3 
9 = • 0 
0.0 

311.3 

3.3 
3.0 
3.0 
3.0 
3.0 
3.0 
3.3 
0.0 
3.0 
3.0 
3.0 

0.0 

3.3 
0.0 
3.3 

0.0 

3.0 
3.3 
3.3 
0.0 
3.3 
3 . 3 
3.3 
3.3 
19.0 



19.3 



3 ERCENT 
T I Mr 



6.1 
0.0 
4.8 
16.7 
37.6 
0.0 
0.0 
0.0 
29.1 
0.0 

94.2 

5.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0„0 
0.0 
0.0 
0.0 
0.0 

0.0 

0.0 
0.0 
0.0 

0.0 

0.0 
0.0 
0 .0 
0.0 

o.o 

0.0 
0 .0 
0.0 
5.9 

5.8 



0 
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ACADEMIC LEARNING TIME TEACHER DATA SUMMARY — 2 \3 SEMESTER 19B2-B3 



TARGET STUDENT im INSTRUCTOR" BEHAVIOR SUMMARY 



TIME 
C MIM.S) 



3 ERCENT 
TIME 



TIMEOAf 
CMIN.S) 



learner: 
learner: 
l?arner: 
learner: 



ENGAGED JR I T TEN 
ENGAGED ORAL 
ENGAGED COVERT 

ENGAGED DIRECTIONS 



TOTAL LEARNER ENGAGEMENT 
LEARNER: MOT ENGAGED INTERIM 

l-arner: not engaged wait 
learner: not engaged offtask 

total learner no n -engagement 

INSTR: NO N -DIRECT INSTRUCT. 



instr: 
instr : 
instr: 
instr : 
instr: 
instr: 
instr: 



ACADEMIC MONITORING 
ACADEMIC FEEDBACK 
ACADEMIC 3UEST I ON 
EXPLANATION - NEED 
EXPLANATION - : LANNED 
STRUCTURING/DIRECTING 
TASK ENGAGMT FEEDBACK 



INSTR.* TOTAL DIRECT INSTR. 



33.1 
17.0 
156. 0 
4 0.3 

256.0 

7.3 

2 3.3 
37.3 

67.3 



141.3 

4.0 
77.3 
4 0.3 
14.3 

7. 3 
3P.0 

2.0 

1 B2.3 



x0.2 
-5*3 
51.4 
12.4 

79.3 

2. .2 
7.1 
11.5 

20.7 



43,7 

1.2 
23 . R 
12.4 
. 4.3 

2.2 
1 J .9 

0.6 

5 5.3 



4.7 
2.4 
23.7 
5.7 

35.6 

1 .0 
3.3 
5.3 

9.5 



23.1 

3.5 
11.0 
5.7 
2.0 

i .o 

5.4 
3 . 3 

25.3 



pdcus: 
*ocus: 



TARGET STUDENT 
GROJP 



JOINT LEARNER X INSTRUCTOR MOVES: 



ENRAGED NON-Dt RECT INSTR. 
NOT ENGAGED NON-DIRECT INSU 
FNGAGED DIRECT INSTRUCTION 
ENGAGED DIRECT INSTRUCT. 



NOT 



IMPORTANT INSTRUCTOR MOVES: 

ACADEMIC FEEDBACK TO TS 
ACADEMIC FEEDBACK TO ^ROU» 
PLANNED EXPLANATION TO GROUP 
STRJCTURING/DIRECT T N5 -GROUP 



29.3 
15 3.3 



76.0 
65. 3 
180.3 
2.3 



12.3 
65. 3 
7.3 
34.3 



9.0 
47.4 



23.5 
20.1 
5 5.7 
0.5 



3.7 
20.1 
2.2 

1.0.5 



> .1 

21 n'i 



13.9 
3.3 

?5.7 
3.3 



I .7 

1 .3 
*.9 



9 
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APPENDIX E 
SOURCE LISTING OF BASIC PROGRAMS 



283 " 



PROGRAM LOGCODE 



ERIC 



10 CLEAR 2500 

20 DEF FN UU(A$)-VAL(LEFT$(STR$(VAL(A$)),LEN(STR$(VAL(A$)))-2)) 

30 DEF FN URZ(A$)-VAL(RIGHT$(A$,2)) 

40 DEF FN PZ(LZ,RZ)»100*ABS(LZ)+ABS(RZ) 

50 DEF FN sa(L%)=INT(U/100) 

60 DEF FN SRZ(R%)=RZ-(INT(RZ/100))*100:GOTOl480 

70 LPRINT" *** ERROR *** SEE SCREEN MESSAGE" : RETURN 

SL P " NT4PRINT " **** " ;A$; " IS M INVALID ENTRY **** - RE-ENTER --":GOSUB70 : 
RETURN 

90 PRINTU8IHG"##/##»;FH8LX(DX);F«J8Ra!(DX);:RETURN: 'PRINT DATE MM/DD 
100 A$=NU$ : PRINT: INPUT" MAKE ANY CHANGES ( Y/N)" ;A$ : A$=LEFT$ (A$ , 1 ) : RETURN 
10 GOSUB90 iP RINT C Z; "«" ;C$ (C%) ;TAB(43 );: PRINT USING "##:##»:FN8LX(TBX)-FMSRX 

(TBZ);:PRINTTAB(49);TAZ ; ;TAB<36) ;SZ;"=" ;S$(SZ) : RETURN » FNSL ^ TB ^ >™SRt 

i 2 L,^ RINT " SI 2^ "» M ;AN%;:LPRINTTAB(5); CZ;"=" ;C $(CZ) ;TAB(43) ; : LPRINT USING ••# 
.#:##";FM8LX(TBX);F»8R«TBX);:IPRIMT TAB(49 ) ; TAZ; « ' " ;TAB 56 ) SZ- "=" • SSfsV) RETURN 

"TIME" ; TAB( 49 )" TIME" ; TAB( 56 )" TASK" : LPRINT" NO. " ; TAB( 6 ) ; "ACADEMIC SUBJECT" • TAB( 43 

);"BEGUN";TAB(49)"SPENT";TAB(56)"SUCCESS";CR$:RETURN ' 

140 PRINTTAB(12);: INPUT " PRESS <ENTER> KEY TO CONTINUE ..." ;A$ : RETURN 

150 IF ID^=MD% OR DZ-MDZ OR SCZ=MDZ OR TB%=MD% OR TAZ=MD% THEN PRINT"**** ACTIVI 

TY NOT SAVED DUE TO MISSING DATA ****"-RETURN ALUV1 

SUB110 % ( f^ll ID%:Dk%W 

170 SCZ*FNPZ(SZ,CZ):TAZ=EM%-BM%: RETURN: 'PACK ACT. DATA 
180 IDZ-DAZ(ANZ,1):SIZ*FNSRZ(IDZ):TIZ*FNSLZ(IDZ) 

200 A$=NU$: INPUT" (OR . TO EXIT)" -1$ : RETURN 

210 CLS: PRINT: PRINT" **** NO DATA/ FILE LABELED **** CAN'T CONTINUE" : PRINT" UNLES 
S YOU RETRIEVE OLD FILE OR LABEL' NEW ONE" : GOSUB140 : RETURN 

n 2 ° SJ5f ;™f iSJ S PRINT " **** STUDENT OR TEACHER ID NEEDED TO CONTINUE ****": GOSUB14 
U tGOSUB1770 : RETURN / 

230 PRINT: PRINT" ENTER DATE (MMDD)" ; : GOSUB200 : IF A$=P$ THEN RETURN 

240 M2-FNUL2(A$):DZ-FNUR2(A$/:IFM?.<10RM%>12THEN250 ELSE IF D%<10RD%>MO%(M% )THEN 

250 ELSE D%=FNPrUM%,D%):PR^T" DATE = ";:GOSUB90 : RETURN MURU/ °' M0/ ' W ;THEN 

250 D%=MDZ:GOSUB80 : RETURN - 

260 'INSERT ACTIVITY DATA/ 

tin Ini^ln™'* 1 T ° ^^G 08 " 8420 : » A$=P$ THEN RETURN ELSE NA%=ANZ 
280 GOSUB150 : NEXTANZ: RETURN 
290 ' INCREMENT DATE 

300 MZ«FNSLZ(DZ):DZ«FNSRZ(DZ): IF M0Z(MZ')»DZ THEN D%=0:M%=M%+1 
310 IF MZ>12 THEN M%=1 : YR%= YRZ+l 
320 DZ-DZ+1 : DZ«FNPZ(MZ ,DZ) : RETURN 

330 'CHECK TIME IN A$ AND CONVERT TO MIN'S AND 24 HR CLOCK 
340 TZ=0:TM%=0: IF LEN(A$)>4 THEN RETURN 

!pL H ! BFNUU(A$): ^ FNURZ(A$):IF HK1 0R H%>23 0R M% <° °* M ^>59 THEN GOSUB80 : 
Kb 1 URN 

360 IF H%<6 THEN H%=H%+12 

370 TMZ-60*HZ+MZ:T%«FNPZ(HZ,MZ):RETURN 

380 ' CHECK TASK SUCCESS 

390. SX-VAL<A$):IF(SX>0 AND SZ<4)OR A$*"0" THEN RETURN ELSE SZ-1:GOSUB80 : RETU 
RN 

406 ' CHECK CONTENT (SUBJECT) * 

410 CZ-VAL(A$):IF(CZ>9 AND CZ<31)OR(CZ>39 AND CZ<44)THEN RETURN ELSE CZ-MDX-GOSU 

B80 : RETURN 4 ousu 

420 PRINT: PRINT" ENTER ACTIVITY DATA ON ";:GOSUB90 : PRINT: CZ-MDZ- SZ=MDZ- SCZ-MD 
Z: TBZ-MDZ: TEZ-MD?: TAZ-MDZ : BMZ-0; EMZ-0 MD/..SC4 MD 
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% 3 ?HEN430 H SUBJECT CODE " ;:GOSUB20 ° • IFA$ a P$THEN RETURN ELSE GOSUB400 : IF C%=MD 

440 PRINT" TIME STARTED" j : GOSUB200 ■: IFA$=P$THEN RETURN ELSE GOSUB330 -IF T7=0 
THENGOSUB80 :GOTO440 ELSE TB%*T%: BM%-TM% 

450 PRINT" TIME STOPPED" ; : GOSUB200 : IFA$=P$THEN RETURN ELSE GOSUB330 -IF T?=0 
THENGOSUB80 :GOTO450 ELSE TE%=T%: EM%-TM%: IF EM%-BM%< a 0 THENPRINT: PRINT" TIME 

STOPPED";TE%;" NOT GREATER THAN TIME STARTED" ; TB%: GOSUB80 :GOTO450 
460 PRINT" TASK SUCCESS (1-HI, 2=MED, 3=LO , 0=MISSING )" ; : GOSUB200 -IF A$=P$ THE 
N RETURN ELSE GOSUB380 : IF S%=-1 THEN 460 ? 
470 GOSUB170 : RETURN 
480 'FIND ACTIVITY 

490 PRINT: PRINT" TIME STARTED OF ACTIVITY TO MODIFY ON ";:GOSUB90 :PRINT:GOSUB 
200 :IF A$=P$ THEN RETURN ELSE GOSUB 330 : IF T*fO THEN 490 .™^l.0UbUB 

510° SUt^S^q^I-J^ _1 . : . IF (DA%(A ^^)= T ^AND(DA^(AN%,2) = D%) THEN RETURN 
510 NEXT AN^:CLS:PRINT:PRINT" *** TIME ";A$;" NOT FOUND ***•• : GOT0490 
520 'CHANGE ACTIVITY 

530 GOSUB480 : IF A$=P$ THEN RETURN ELSE GOSUB180 : PRINT: PRINT" ACTIVITY TO PHA 
NGE:":PRINT:GOSUB110 : PRINT: PRINT" - RE-ENTER ENTIRE ACTIVITY" : PRINT^GOSUB420 % 

:IF A$=P$ THEN 530 ELSE GOSUB150 :GOTO530 fKlNl.COSUB420 
540 'DELETE AN ACTIVITY 

550 GOSUB480 : IF A$=P$ THEN RETURN ELSE GOSUB180 : PRINT: PRINT" ACTIVITY TO DF t 

0 TE: iF R A$<>"?" u ?H E S ,T^ Rim " SHALL 1 DELETE IT ™ ~%S» 5 ««55 

T PLEASE .?." CLS : PRINT: PRINT" DELETING ACTIVITY ... ONE MOMEN 

560 IF AN%=NA% THEN 580 

570 FOR J=AN% TO NA%-l:FOR K=l TO 5 : DA%( J , K)=DA%( J+l , K) : NEXT K: NEXT J 
580 FOR K=l TO 5:DAX(NAX f K)-MDZ:NEXTK:NAZ-NAX-l:GOTO550 
590 'CHANGE DATE 

*00 CLS:PRINT^RINT" DAY TO MODIFY: ":GOSUB230 : IF A$=P$ THEN RETURN ELSE IF D7 
-MDX THEN 600 ELSEGOSUB100 : IF A$="Y" THEN 600 ELSE RETURN 
610 MAKE CHANGES PERMANENT 

620 PRINT: PRINT" DO YOU WANT THESE CHANGES TO BE MADE PERMANENT" • PRINT" - T F 

t iT"»S;F? I ^ C B^lET G08UB20 ° A$<> " YM THEN ^ ELSE GOSUB102 ° : RETURN ' 

6*0 IF DF$="NONE" THEN GOSUB210 : RETURN 
650 IF ID%=MD% THEN GOSUB220 

660 CLS: PRINT: PRINT" MODIFY LOG BOOKLET ACTIVITIES"- PRINT 

670 PRINT" CD - CHANGE DATE OF DAY TO MODIFY IF NOT ";:GOSUB90 • PRINT 

680 PRINT" IA = INSERT ACTIVITY ON ";:GOSUB90 : PRINT 

690 PRINT" CA = CHANGE ACTIVITY ON ";:GOSUB90 : PRINT 

700 PRINT" DA = DELETE ACTIVITY ON ";:GOSUB90 -PRINT 

Von ^r^T" ElV,TER CH °ICE";:GOSUB200 : IF A$-P$ THEN GOSUB 610 : RETURN 
720 IF A$="CD" THEN GOSUB 590 ELSE It' A$="IA" THEN GOSUB 260 ELC V ■# A$="CA" T 
HEN GOSUB 520 ELSE IF A$="DA" THEN GOSUB 540 ELSE GOSUB80 
730 GOTO 660 

740 ' INSERT LOG BOOKLET (A WEEK) 

750 IF DF$=" NONE "THEN GOSUB210 : RETURN 

760 IF ID%=MD% THEN GOSUB 220 

.bIV':™^ PRINT " DATA FILE FULL " N ° M0RE DATA ^N BE W8ERWp":G0S0 

780 CLS: PRINT: PRINT" INSERT NEW LOGBOOK DATA" : PRINT: PRINT" DATS AT B F C INN 

iuBlSo °f I ^p r A U ^ 0 780 IF A$SP$ "™ ELSE » D%=MD% THEN 780 ELSE GO 

790 FOR DW%-0TO4: CLS : PRINT: PRINT" DAY IS ";DW$(DW%);" - ";:GOSUB90 -PRINT-GOSU 

B260 :GOSUB100 : IF A$="Y"THEN CLS: PRINT: PRINT: GOSUB680 -PRINf.GObU 
800 GOSUB290 : NEXTDW%: GOSUB1020 : GOTO 780 
810 'LIST DATA TO PRINTER 
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820 GOSUB920 : IF NA%*0 THEN RETURN 

830 T^MDSiFOR ANX-1 TO NA%:GOSUB190 : IF D%<>T% THEN GOSUB 130 
840 GOSUB120 : T%»D%: NEXTAM: RETURN 
850 ' PRINT DATA FILE HEADER 

860 CLS:PRINT:PRINTTAB(12);"ALT TEACHER LOG DATA" : PRINT- PRINT 

870 PRINT" DATA FILE NAME: ";DF$ 

880 PRINT" STUDENT NAME: ";SN$;" ID# =";SI7. 

890 PRINT" TEACHER.NAME: ";TN$;" ID# =";Tl2 

900 PRINT" SCHOOL: '";SC$ <fc ' 

910 PRINT" YEAR: ";YRX;" - nO. OF ACTIVITIES : " ;NA% : PRINT: PRINT: GOSUB140 : RETURN 
920 LPRINT CHR$(12):POKE&HFC05,0:LPRINTCR$,CR$ -khukw 
930- LPRINT TAB(IO);" ALT TEACHER LOG DATA" : LPRINT CR$,CR$ 
940 LPRINT" DATA FILE NAME: ";DF$ 

950 LPRINT" STUDENT NAME: ";SN$;" ID#=" ;FNSR%( ID%) 
960 LPRINT" TEACHER NAME: ";TN$;" ID#=" ;FNSL%( 
970 LPRINT' ? SCHOOL: ";SC$ 

980 LPRINT" YEAR: ";YRZ;" - NO v OF ACTIVITIES: ";NA%: LPRINT CR$ ,CR$ : RETURN 
990 'LIST DATA TO SCREEN 

1000 GOSUB850 : FOR J=1T0 NA% STEP14:F0R 'AN%-J TO J + 13:IF AN%>NA% THEN GOSUB'40 
: RETURN 

1010 GOSUB190 :GOSUB110 : NEXTAN2: GOSUB 140 : N. VTJ: RETURN 
1020 ' WRITE DF$ TO DISK 

1030 CLS: PRINT: PRINT" NOW SAVING ";DF$;" ON DISK ..." 

1040 OPEN"0",l,DF$:PRINT#l,DF$:PRINT?fl,CF$:PRINT#l,SN$:PRINT#l,TN$:PRINT#l SC$-P 
1050 IF NA%»0 THEN 1070 

1060 FOR J-l TO NA2:FOR K»l TO 5 : PRINT#1 ,DA%( J, K) : NEXTK: NEXTJ 

1070 CLOSE: RETURN 

1080 'READ DF$ FROM DISK 

1090 CLS: PRINT: PRINT" NOW READING ";DF$;" FROM DISK ..." 

1100 ON ERROR GOTO 1150 : OPEN " I" , 1 ,DF$ : i'lNPUT#l ,A$ : INPUT#1 ,B$ : IF A$<>DF$ THEN PR 
INT" *** INVALID ALT LOG FILE ***": GOSUB140 :GOTOll40 

11 10 CF$=B$ : INPUTtfl ,SN$: INPOTfl ,TN$: INPUTfl ,SC$: INPUttl ,YR%: INPUT#1 ,NA%: INPUT#1 

SIX: INPOT#l ,TIX: INPUT#1 , IDZ: IF NAZ-0 THEN 1140 

1120 FOR J=l TO NA%:FOR K=l TO 5 : IF EOF(l) THEN 1160 

1130 INPUT#1, DA% ( J, K): NEXTK: NEXTJ ' 

1140 CLOSE: ON ERROR GOTO 1450 : RETURN 

1150 ON ERROR GOTO 1450 : IF ERR/2<>"53 THEN 1450 ELSE CLS:.PRINT" *** FILE NOT Fn 
UND ***": GOSUB 140 :RESUME1140 11 Lb NOT FO 

1160 CLS: PRINT" EOF IN DATA FILE UNEXPECTED — SEE TED! ":G0SUB140 -GOTO1140 
1170 'FIND A DF .w±vi*«n# 

1180 GOSUB 1250 

1190 GOSUB1340 : PRINT: PRINT" WHAT IS THE NAME OF THE DATA FILE YOU WANT TO RETRI 
EVE?":GOSUB200 : IF LEFT$ (A$ , 1 )«P$ THEN RETURN ELSE IF A$»NU$ THEN 1190 
1200 FOR J=l TO FCX:Tf A$=FL$(J) THEN 1220 

1210 NEXTJ:.PRINT" FIKE NOT POUND IN CATALOG " : GOSUB 140 :GOT01190 
1220 DF$=A$: GOSUB 1080 : RETURN 
1230 'DELETE A DF 

1240 PRINT" HERE IS WHERE DELETE GOES":GOSUBl40 : RETURN 
1250 'READ FILEL'IST 

N 2 1280 N ERR ° R G0T ° 1290 :FC%=0:OPEN ' Vt,, ' 1 '" FILEL1;Sr,:FO R J*! TO MF%:IF EOF(l) THE 

1270 INPUT#1,FL$(J):FC*»FCZ+1:NEXTJ I 
1280 CLOSE: ON ERROR GOTO' 1450 : RETURN 



/ 



1290 ON ERROR GOTO 1450 : IF ERR/2053 THEN 1450 nLSE PRINT" FILELTST riot ™'jND" 
: RESUME 1280 " . luu ^' ai lNU1 - JlNU 

1300 ' WRITE FILELIST TO DISK , 



1310 OPEN"0",l,"FILELIST":FOR J=l TO FC%: IF FL$(J)="0" THEN 1330 . 
1320 PRINT#1,FL$(J) 
1330 NEXTJ: CLOSE: RETURN 
1340 ' PRINT FILELIST 

1350 CLS: PRINT" TOTAL # OF FILES =" ; FC%: PRINT: PRINT" CATALOG OF EXISTING .BSERVA 
TION SYSTEM/DATA FILES :": PRINT axohw, udsckva 

1360 FOR J=l TO FCZ STEP24:FOR I=J TO J+23 STEP4: PRINTFL$(I) ,FL$.(I+1) ,FL$(I+2) F 
L$(I+3):NEXTI:PRINT:GOSUB140 : NEXTJ: RETURN 
1370 1 USE AUX. PRINTER 

1380 CLS:PRINT:PRINT" IS THE AUXILLIARY PRINTER HOOKED UP TO THE RS-232 AND POWE 
R ON?":GOSUB200 : IF LEFT$ ( A$ , 1 )<>"Y" THEN RETURN 
1390 POKE &HFC00,72 

1400 POKE &HFC01,60:POKE &HFC02 , 6:POKE &HFC04 , 0: POKE &HFC05 , 0: POKE &HFC06 0:POKE 
&HFC07,0:POKE 16421, 2: POKE 16422, 9:POKE 16423,252 o.u.tmt. 
1410 PRINT: PRINT" CHECK THE AUXILLIARY PRINTEr'fOR A MESSAGE LPRINT" *** AUX 
ILLIARY PRINTER READY ***": LPRINT CHR$(12) ^ 
1420 RETURN 
1430 'PRINT DA% 

.1440 FOR J=l TO NA% : FOR K=l TO 5 : PRINTDA^ J, K) j : NEXTK: PRINT: GOSUB140 : NEXTJ: RET 

1450 CL0SE:PRINT"ERR0R#";((ERR/2) + O;" AT" ; ERL: PRINT" (SUB 1 IF>49)" 
1460 IF ERR/2=61 THEN PRINT" *** WARNING *** THIS .ERROR MEANS THAT YOUR DISK IS 
FULL.":PRINT" YOU CANNOT CREATE ANY MORE FILES ON THIS DISK, ": PRINT" YOU CAN HO 
.WEVER , MODIFY EXISTING ONES.":END ' H 

1470 .END 

1480 ON ERROR GOTO 1450 ' :CF$="NONE": DF$= ! "NONE" 

««(JS!5)!;«T«) ,tt 2=750:CR$=CHRS (13 > : NU$ =" ' ' : ii-w.iu-o.na.iMi.DM 

1500 DEFINT I-N 

1510 DIM CH$(8):F0RJ=1T08:READCH$(J):NEXTJ 

1520 DATA LDF.ILB, MLB, MDH, RDF, LDP, LDS.AUX 

1530 DIM DW$(4):FORJ=0TO4:READDW$(J):NEXTJ 

1540 DATA MONDAY, TUESDAY, WEDNESDAY, THURSDAY, FRIDAY 

1550 DIM ml( 12 ) :F0RJ=1T012:READM0%(J): NEXTJ 

1560 DATA 31 ,28,31,30,31,30,31,31,30,31,30,31 

1570 DIMC$ (43 ):FORJ=10T030:READC$(J): NEXTJ 

1580 DATA DECODING/PHONICS, WORD STRUCTURE , WORD MEANING, COMPREHENSION, READING P 
RACTICE, SPELLING, GRAMMAR , COMPOSITION (CREATIVE WRITING ), READING RELATED-- OTHER 
, READING BE LOW TEST LEVEL (COPY) • K 

1590 DATA ADD/SUBTRACT (NO REGROUPING ) , ADD/SUBTRACT (REGROUPING), COMPUTATIONAL 
TRANSFER, PLACE VALUE/NUMERALS, MULTIPLICATION .DIVISION , FRACTIONS/DECIMALS SPA 
TIAL APPLICATION, VERBAL APPLICATION (WORD PROB. ) ,MATH RE LATE D- -OTHER 
1600 DATA MATH BE LOW TEST LEVEL i^uiMCK 
1610 FOR J=40 TO 43 : READ C$(J):NEXTJ 

1620 DATA SCIENCE, SOCIAL STUDIES, FOREIGN LANGUAGE , OTHER ACADFMIf 
1630 DIM S$(3):5$(1)="HI": S$(2)="MED": S$ (3 )="LO" : S$(0)="MSG" ' 
1640 'REM MAIN CHOICE LIST 

1650 GOSUB850 : CLS : PRINT: PRINT" PROGRAM LOGCODE - MAIN* CHOLCE LI^'-PRINT 
• 1660 PRINTCH$(1);" = LABEL A NEW DATA FILE (NEW STUDENT)" 
1670 PRINTCH$(2);" = INSE r " LOG BOOKLET(S)" 
1680 PRINTCH$(3);" = MODIn LOG BOOKLET" 
1690 PRINTCH$(4);" = MODIFY DATA FILE HEADER INFO" 
1700 PRINTCH$(5);" « RETRIEVE DATA FILE FROM DISK STORAGE" 
1710 PRINTCH$(6);" = LIST DATA FILE TO PRINTER" 
1720 FRINTCH$(7);" = LIST DATA FILE TO SCREEN" 

1730 PRINTCH$(8);" - SET UP AUXILLIARY PRINTER (HEATH OR DEC WRITER)" • PRINT 

1740 print" enter choice"; : gosub200 : if a$=p$ thej^pr int: print" exit program lo 
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GCODE AND RETURN TO BASIC": END 

1750 FOR L=l TO 8: IF A$=CH$U) THEN ON L GOSUB 1970 ,740 ,630 1770 1170 810 
,990 ,1370 :GOTOl640 ' ' ' ,01U 

1760 NEXTL:GOSUB80 :GOT01640 
1770 1 MODIFY DF HEADER 

1780 IF DF$="NONE" THEN GOSUB210 : RETURN 

1790 CLS : PRINT: PRINT" INSERT/MODIFY DATA FILE HEADER" : PRINT 

1800 PRINT" SN = STUDENT NAME AND IDlT 

1810 PRINT" TN = TEACHER NAME AND ID#" 

1820 PRINT" SC = SCHOOL NAME" 

1830 PRINT" L = LIST HEADER INFO": PRINT 

1840 PRINT" ENTER CHOICE" ;: GOSUB200 : if A$=P$ THEN GOSUB 1920 : RETURN 
, 1850 IF A$="SN" THEN GOSUB 1870 ELSE IF A$="TN" THEN GOSUB 1890 ELSE IF A$="SC 
"THEN GOSUB 1910 ELSE IF A$="L" THEN GOSUB 850 ELSE GOSUB80 
1860 GOTO1790 

1870 PRINT: PRINT" ENTER STUDENT NAME" ; : GOSUB200 :SN$=A$ 

1880 PRINT: PRINT" ENTER STUDENT ID#" ; : GOSUB200 : SI%=W*L(A$ ) : RETURN 

1890 PRINT: PRINT ENTER TEACHER NAME" ; : GOSUB200 :TN$=A$ 

1900 PRINT: PRINT" ENTER TEACHER ID#" ; : GOSUB200 : TIZ-VAL(A$ ): RETURN 

1910 PRINT:PRINT" ENTER SCHOOL NAME" ; : GOSUB200 : SC$=A$* RETURN 

1920 1 CHECK ID'S, PACK, AND UPDATE ANY EXISTING RECORDS 

"^SlMTfflSoJJg 99 THEN PRINT: ^ INTSI ^" * INVALID STUDENT ID# - RE-ENTER 
^wSmsSSiTSS 6 ^ PRINT:PRINTTI ^" IS INVALID. TEACHER ID, - RE-ENTE, 

HH RE D TURN P%(TU ' Sa):IF ID%<>DA%(1 ' 1) THEN F0R J=1 ™ NA% : DA%( J , 1 )» ID% : NEXTJ 

1970 REM-TO LABEL A NEW DATA FILE XXXXX.YYYYYY 
1980 GOSUB1250 

1990 CLS: PRINT: PRINT" INSTRUCTIONS ON LABELING": PRINT" — .. 

: PRINT 

2000 PRINT" A DATA FILE NEEDS A UNIQUE LABEL IN ORDER TO IDENTIFY" : PRINT" IT FOR 
SUBSEQUENT USE. THE LABEL, OR NAME, HAS TWO PARTS" : PRINT" SEPARATED BY A PERU 

u • . r K IN I 

2010 PRINT" THE FIRST PART OF THE LABEL MUST BE "ONE WORD CONS ISTING" • PRINT" OF N 
0 MORE THAN 8 CHARACTERS , WITH NO EMBEDDED BLANKS" : PRINT" OR PERIODS ' OR SLASHES 
THE FIRST CHARACTER CANNOT BE" FfcKlUUb OR SLASHES . 

2020 PRINT" A NUMBER.": PRINT: GOSUB140 
2030 CLS: PRINT: PRINT 

2040 PRINT" THE SECOND PART OF THE LABEL (AFTER THE PERIOD) IS THE" • PR TNT" mamr 
OF THE OBSERVATION SYSTEM WITH WHICH THE DATA FILE" : PRINT" IS TO BE ' ASSOC IATED 
THE TWO PARTS MUST BE SEPARATED" ASSOCIATED. 

2050 PRINT" BY A PERIOD. E.G. , ' MARC H4. PROBING ' IS A VALID DATA" * PRINT" FIFE TA 
BEL. THE FIRST PART, MARCH4, UNIQUELY IDENTIFIES : PRINT THE DATA FILE InD T.4E 
REMAINDER INDICATES WHICH" ' AND THb 

2060 PRINT" OBSERVATION SYSTEM IT BELONGS WITH. ": PRINT: PRINT" WHAT IS THE LARFF 
FOR YOUR NEW DATA FILE?";GOS'!B 200 rmiN i fK in i WHAl lb THE LABEL 

2070 IF LEFT$(A$,1)=P$ THEN RETURN ELSE IF A$= M " THEN 1990 

Z° olsullHO^ap'cO^l^ 1 !, 1 ,"^ 1990 :REM T ° S "" T 2 ™™ 

2100 B$*Z$ :C LS:PRINT" !S ";B$.-" THE NE.W LABEL YOU WANT TO PERMANENTLY USE"-PRINT 
ZeT 2?00 NEW fILE? " :G0SUB 200 :IF ^"T $ (A?,1)=P $ THEN RETURN ELSE »™. 

2110 IF LEFT$(A$,1)<>"Y" THEN 1990 

2120 CF$-CX$:DF$-Z$:NAa!-0:SN$-"UNSPECIFIED":TN$-SN$:SC$-SN$:IDZ-0-SlX.O-Tiy-0-ny 
*0:GOSUB177O :GOSUB 1020 u.su U.TU-O.M 

2130 FC*=Fa+l:FL$(FC2)=DF$:GOSUB1300 : RETURN 
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2140 REM- SUB TO TEST VALIDITY OF LABEL FOR TRSDOS FILE NAME 
2150 C0Z=-1:IF LEN(A$)>8 THEW 2240 

2160 I=ASC(MID$(A$,1,1)):IF I>=48 AND I<=57 THEN 2220 

2 !In r^ont 1 T ° LEN ( A! ? 5 : B $= MID ^ A$ , J , I ) : I=ASC ( B$ ) : IF ( I>=48 AND K-57) OR (I>=65 
AND IO90) THEN NEXT J ELSE GOTO 2230 

2180.JOR J-l TO FC%:I=INSTR(FL$(J),P$):IF I>0 THEN B$=MID$(FL$(J) , 1 , 1-1 ) ELSE B$ 
2190 IF B$=A$ THEN 2210 ELSE NEXT J 

2200 C0%=+1 : PRINT: PRINT Z$;" IS A VALID AND UN IQIJE FILE LABEL. »: PRIN^ RETURN 

2210 CLS:PRINT:PRINT" A FILE WITH THIS LABEL ALREADY EXISTS - DUPLICATES" • PRINT" 

ARE NOT ALLOWED. ":GOSUB140 :GOSUB1340 : RETURN 

2220 PRINT: PRINT" LABEL CANNOT BEGIN WITH A NUMBER -" j LEFT$ ( A$ , 1 ) ; GOSUB 140 : RE 
TURN 

2230 PRINT: PRINT" LABEL HAS AN INVALID IMBEDDED CHARACTER = ";B$: GOSUB 140 : RET 
URN * 

2240 PRINT: PRINT" LABEL HAS MORE THAN 8 CHARACTERS - NOT ACCEPTABLE": GOSUB 140 
J RETURN 

" 5 ?w^n 1 iI»r J «. TO LEN(A$):IF MID$(A$,J,1)=P$ THEN 2260 ELSE NEXT J: PRINT"* 
** INVALID LABEL *** PERIOD IS MISS ING .": GOSUB 140 : RE URN 

2260 CX$=MID$(A$,J + l,LEN(A$)): A $=MID$(A$,l,J-l):FOR J-l TO FC%: IF CX$=FL$(J) THE 
„ 2 HT S LSE NEXT SPRINT" *** ERROR *** ";CX$;" WAS NOT FOUND IN YOUR CATALOG A 
S":PRINT" AN OBSERVATION SYSTEM LABEL" : GOSUB 140 : RETURN 
2270 CO%=l:PRINT:PRINTCX$;" IS A VALID OBSERVATION SYSTEM LABEL. " : RETURN 



200 



PROGRAM ALTCODE 
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eric 



10 CLEAR 25U0:GOTO3580 

20 LPRINT" *** ERROR *** SEE SCREEN FOR DETAILS" : RETURN 

30 LPRINT DA$( J) ;" - " ; TAB( 34 ) ; DA( J) ; : IF PJ%(j)=:0 THEN LPRINT- RETURN 

40 K-DA(J)-1: LPRINT = ";PJ$(PJ*(j) +K ) : RETURN 

Buf»-"?S- 0 -A2 $ 60 .. 

,\ * » A1!? > » A2? ! ;A3$: L=1:GOSUB70 : L=2: GOSUB70 -RETURN 

60 FOR J=0 TO 7:LM%(J,L)=0:IM*(J,L)=0:NEXTJ:FOR J=0 TO 2: FM%(J L)=0- NEXTJ- RETURN 

80 CLS:PRINTTAB(12)» *** ALTOS IDENTIFICATION DATA ***"• RETURN 
90 CLS:PRINTTAB(12)" *** ALTOS EDUCATIONAL ACTIVITY DATA ***" RETURN 
00 CLS:PRINTTAB(12)» *** REAL-TIME CODING DATA ***" -RETURN 
10 CLS:PRINT:PRINT:PRINT" *** INVALID CHOICE ***":GOSUB150 -RETURN 
20 GOSUB20 : PRINT" *** WARNING *** YOUR INVALID ID INFO PREVENTS YOU FRONT" - PR 

130 PR INT" ^NOTE^-- ^TO^RETAIN ^AM^ TTPM^q ^ CODING fpRINT" MtV : „ 

iju rKlN 1 NOTE — TO RETAIN AN ITEM'S PREVIOUS VALID VALUE AND " • PR TNT" cjktp ™ 

THAT SilSlj^Sr"* ° NW - ° THERWISE " : -PRI^T ENTER^THE ' NEW VALUE FOR^ 
TIONAL ACTIVITY INFO ON DISK" : PR INT: RETURN 

150 PRINTTAB( 12);: INPUT " PRESS <ENTER> KEY TO CONTINUE " - A$ - RFTIIRN 

T NO SPAPF? v p 7 n ENTE 5 ABBREVIATI °NS FOR CODES ONE LINE AT A TIME,":PRIN 
T NO SPACES — E.G., EOAFTS <ENTER>" : PRINT: RETURN 
180 PRINT DA$(J);" : "; DA( J) : RETURN 
190 'READ A$ 

200 A$=NU$: INPUT" - ENTER INFO (OR . TO EXIT)" ; A$ : RETURN 

^tSrn" T:INPUT " 00 Y ° U WANT T ° ^ ANY CHANGES (Y/N)";A$:A$=LEFT$(A$ > 1) 

220 'SPLIT A$ INTO 3 PRS 

24 3 0 A g^if ^ 
, 260 ^11^ 

280 ^S*Ia X ^ > ; A 2SS C C > « AW-A^Al.-rlOO-Aa.lO , -TOM 

300 ^2S A ^lSr2 C i3 ' iiii^S-^" 1 ^ ^ . 2 . 1 » s A3.-VAI.CRXCI.M C A3 . 1 » : «TU» ' 

310 A%»100*A1%+10*A2%+A3%: RETURN 

320 PRINT: PRINT DA$ ( J) ; : GOSUB190 : IF DA(J)=0 THEN 330 ELSE IF LEFTS (A3 n-P<! t 

HEN RETURN ELSE IF A$=NU$ THEN 340 LEFT!? (AS , 1 )-P$ T 

330 DA(J)=VAL(A$):IF fcj-10) OR (J=20) THEN GOSUB 460 ELSE IF J=18 THEN GOSUB 49 
340 GOSUB 350 : IF DA(J)=0 THEN 320 ELSE GOSUB 180 -RETURN 

%*JV»2 Ts^Z esT eao«° A" 72 T , 

So .•SLCidC ' 68 ° - 680 M0 '* ™ 

380 ??H E U CK°DATF. DA(J,=0:PRINT:P1UNT " "* ERROR IN " ; DAS (J) ; " «* RE-ENTER": RETURN 
390 A$-RIGHT$(STR$(DA(J)),6) ; (3OSUB220 : AU-VAL(A1$ ) : A2%=VA[ (A'$ ) • A3?- M, ( »n 1 . , 
E GOSUr!60 Am R^JL <=12> (A22>= ° ^ U2l< - n) ANU <«^ A 0) MEN RETURN ELS 

400 ' CHECK OBS# OR <*WfSS SIZE 

410 IF (DA(J)>0) AND (DA(.lXlOOO) THEN RETURN ELSE GOSUB 360 : RETURN 
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420 
430 
440 
450 
460 
470 
480 



' CHECK TCH OR TS # 

IF (DA(J)>0) AND (DA(JXIOOO) THEN RETURN ELSE GOSUB 360 : RETURN 
'CLASS TYPE CHECK •»• ukn 

"iS'Aiia'.J^Sr — » ^ "533 THEN 



THEN RETURN ELSE IF (DA(I)>0) AND (DA 



480 NEXT I: RETURN 

490.DA(J+1)-MVZ:IF DA(J)=MV% THEN RETURN 
500 GOSUB240 : FOR I- J TO J+1:IF DA(I)»MV* 
(D<7) THEN 510 ELSE GOSUB360 : RETURN 
510 NEXT I: RETURN 
520 'SPLIT TIME 

530 An-INT(DA(J)/i00):A2%-DA(J)-AU*100: RETURN 
540 'CHECK BEGIN AND END OF ACTIVITY TIMES 

5 "osSb U 6 B 00 20 :RET U BN AU>0) m UU<24) AND < A2 *>=°> «» <"«60)THEN GO Sl)B 570 
560 GOSUB 360 : RETURN 

' CONVERT TO 24 HR CLOCK 
IF (AU>-1) AND (AU<=6) THEN Al%=AU+12 
DA(J)=AU*100+A2%: RETURN 
' COMPUTE ALLOCATED TIME IF POSSIBLE 
IF (DA(7)-0) OR (DA(29)=0) THEN RETURN 

:RETuSm (7)>DA(29) ™ EN PRINT " *** START TIME EXCEEDS ST0P TIME ***";:GOSUB 360 
630 K=J: J=29:GOSUB520 
60+A22): RETURN 
640 
650 



570 
580 
590 
600 

610 
620 



: DA(30 )-AlZ*60+A2Z:J-7: GOSUB520 , j=K: DA(30 )=DA(30 )-(AU* 



'CHECK # OF STUDENTS IN SAME ACTIVITY 
f!J DA(j)>0) AND (DA(J)<^DA(6)) THEN RETURN 



THEN RETURN ELSE GOSUB 360 : RETURN 

THEN RETURN ELSE GOSUB 360 : RETURN 

THEN RETURN ELSE GOSUB 360 : RETURN 

THEN RETURN ELSE GOSUB 360 : RETURN 



660 'CHECK TS PACING 
670 IF (DA(J)>0) AND (DA(J)<3) 
680 'CHECK TS ACTIVITY 
690 IF (DA(J)>0) AND (DA(J)<8) 
700 'CHECK TASK DIFFICULTY 
710 IF (DA(J)>0) AND (DA(J)<4) 
720 ' CHECK TS INSTRUCTOR TYPE 
730 IF (DA(J)>0) AND (DA(J)<7) 
74.0 'CONTENT CHECK 
750 A=DA(J):IF ((A>9) AND (A<31)) OR ((A>39) AND (A<43» 
THEN RETURN ELSE GOSUB 360 : RETURN 
760 'MAIN LEVEL 
770 GOSUB980 

780 CLS:PRINT:PRINTTAB(6)" 
790 PRINT" L 
800 PRINT" I 
810 PRINT" M 
820 PRINT" 
830 PRINT" H 
840 PRINT" R 
850 PRINT" D 
860 PRINT" p 
870 PRINT" A 
880 GOSUB 190 
PROGRAM": END 
890 IF A$*"L" THEN 
900 IF A$*"I" THEN 
910 IF A$*"M" THEN 



ELSE GOSUB 360 : RETURN 



OR ((A>49) AND (A<59)) 



ALTOS DATA ENTRY/MODIFICATION PROGRAM" 



PRINT 



» LABEL A NEW DATA FILE (FOR A DAY OF DATA ON TS )" 
» INSERT DATA FOR NEW EDUCATIONAL ACTIVIT V IES)" 
= MODIFY DATA ON OLD EDUCATIONAL ACTIVITY( IES )" 

PREVIOUSLY ENTERED AND SAVED ON DISK" 
• MODIFY PREVIOUSLY ENTERED DATA FILE HEADER INFO" 

RETRIEVE OLD DATA FILE FROM DISK STORAGE" 
5 DELETE OLD DATA FILE FROM DISK STORAGE" 
' PRINT CONTENTS OF DATA FILE ON PAPER" 
' SET. UP AUXILLIARY PRINTER (HEATH OR DECWRITER)" • PRINT 
IF LEPT$(A$,1)-P$ THEN PRINT" EXIT ALTOS DATA ENTRY/MODIFICATION 



GOSUB 
GOSUB 
GOSUB 



4170 
2150 
2340 



:GOTO760 
:GOT0 760 
:GOTO 760 
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920 IF A$="H" THEN GOSUB 1170 : GOTO 760 
930 IF A$="R" THEN GOSUB 2940 :GOTO 760 
940 IF A$="D" THEN GO&tfB 3000 :GOTO 760 
950 IF A$-»p" THEN GDSUB3140 : GOTO 760 
960 IF A$="A" THEN GOSUB3470 :GOTO760 
970 GOSUB110 :GOTO 780 
980 ' PRINT HEADER 

990 CLS:PRINTTAB(12);" HEADER INFORMATION: ": PRINT 

J. 0 ^!? 1 !! 1 " OBSERVATION SYSTEM - ";CF$:PRINT" DATA FILE NAME - »j DF$: PRINT' PRINT 
TOTAL* ACTIVITIES =»;NA%;" TRANSITION TIME ; TR% : PRINT: PRINT" TARGET STUD 
ENT NAME - ";TN$:PRINT" CODER NAME - ";CN$:PRINT" COMMENTS - 
010 PRINT: PRINT". DAY START TIME: ";DS;" DAY END TIME: ";DE 
1020 PRINT:PRINT:GOSUB150 : RETURN 

1030 ' ENTER DF HEADER y 

1040 CLS: PRINT" ENTER HEADER INFORMATION" : PRINT 

1050 PRINT" TN •■ TARGET STUDENT NAME" 

1060 PRINT" CN = CODER NAME" 

1070 PRINT" C - COMMENTS, IF ANY" 

1080 PRINT" DS = DAY START AND END TIMES" 

1090 PRINT" L = LIST HEADER INFO":PRINT:PRINT" - NOTE - TO MODIFY HEADER RE 
-ENTER CHOICE": PRINT nvuux HhAUbK , RE 

1100 GOSUB190 :IF LEFT$ (A$ , 1 )=P$ THEN RETURN ELSE IF A$=NU$ THEN 1040 
$^$:GOTO104™ THEN PRINT:PRINT " raAT 18 THE TARGET STUDENT NAME" : GOSUB190 :TN 
01040 ^ A$ "' CN " THEN PRINT!PRINT " ^ IS THE CODER NAME ":GOSUB190 :CN$=A$:GOT 

1130 IF A$="C" THEN PRINT: PRINT" WHEN ENTERING COMMENTS, DON'T USE COMMAS SEMir 
OLONS,": PRINT" OR COLONS ": G OSUB190 : DC $=A$: GOTO 1040 ' ° 

1140 IF A$="L" THEN GOSUB 980 :GOT01040 

nil Gos»no S '': 8 T o H TOio;o :GOSUB32 ° ;DS = M <"^9:GO S U B 3 2 0 =-»E-DA( J ): G OTO1040 
1170 'MODIFY DF HEADER 

1180 IF DF$="NONE" THEN PRINT" YOU MUST LABEL DATA FILE FIRST": GOSUB150 • RETURN 
1190 GOSUB1030 : IF NA%>0 THEN GOSUB 2530 ELSEGOSUB2640 .RETURN 
1200 RETURN 

? 210 'TRANSFER DF TO DA 

1220 K=(AN%-1)*SL%:F0R J=l TO SL%: DA( J )=DF(K+J) : NEXTJ: RETURN 
1230 ' ENTER OR MODIFY ID INFO 

1240 IE %=0: CLS: PR INT" ENTER OR MODIFY ID INFO": PRINT: GOSUB130 
1250 FOR J=l TO 6:GOSUB320 : IF LEFT$ (A$ , 1 )=P$ THEN 1270 
1260 NEXTJ:GOSUB 210 : IF A$="Y" THEN 1250 

1270 PRINT: PRINT", ... PERFORMING ERROR CHECK ON ID INFG .. "-PRINT 

1300 F ° R T ° 6!G0SUB DA(J)= ° THEN G ° SUB 320 =^ , LEFT$(A$,1)=P$ THEN 

1290 NEXTJ: RETURN 
1300 IE %=1 : GOSUB 120 : RETURN 

1310 'INSERT/MODIFY EDUCATIONAL ACTIVITY INFO 

1320 IF IE2O0 THEN GOSUB 120 

1330 GOSUB 1280 : IF IEK>0 THEN RETURN 

1340 EE%=0:CLS:PRINT" ENTER OR MODIFY EDUCATIONAL ACTIVITY INFO" : PR INT: GOSUB 130 

1350 1 BEGIN TIME, NS , PACING, TS ACTIVITY 1-7 

1360 FOR J=7 TO 10:GOSUB 320 : IF LEFT$ (A$ , 1 )=P$ THEN 1460 

1370 NEXT J 

1380 TASK DIFFICULTY AND TS INSTRUCTOR 1-2 

1390 FOR J=17 TO 18:GOSUB 320 : IF LEFT$ (A$ , 1 )-p$ THEN 1460 

1400 NEXT J 
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1410 1 INSTRUCTOR ACTIVITY 1-7 

1420 J*20:GOSUB 320 : IF LEFT$ (A$ , 1 /=P 6 THEN 1460 
4430 ' CONTENT 1-2 AND END TIME 

1440 FOR J=27 TO 29:G0SUB 320 : IF LEFT$ (A$ , 1 )=P$ THEN 1460 
1450 NEXTJ:GOSUB 210 : IF A$="Y" THEN 1350 
1460 ' CHECK EDUC ACTIVITY INFO 

1470 PRINT: PRINT" ... PERFORMING ERROR CHECK ON EDUCATIONAL ACTIVITY INFO ...»:P 
HSO^FOR J=7 TO 29:GOSUB 350 : IF DA(J)=0 THEN GOSUB 320 : IF LEFT$ (A$ , 1 )=P$ THE 

1490 NEXTJ: RETURN 

1500 EE%=1: GOSUB 140 : RETURN 

1510 'READ LINE OF CODES 7 
1520 L=PT%-CT%: PRINT" LINE" ; L; 

Hit folul 220 ^Tlt^'l^ ™ EN mVm ELSE IF A$=NU$ AND THEN 1620 

1540 GOSUB 220 : Al/£=0: A2%=0: A3%.-0: FOR J=l TO 7: IF A1$=LM$(J) THEN 1560 
1550 NEXTJ: GOTO 1630 

1560 Al%=J:FOR J=0 TO 7: IF A2$=IM$(J) THEN 1580 
1570 NEXTJ: GOTO 1630 

1580 A2%=J:FOR J=0 TO 2: IF A3$=FM$(j) THEN 1600 
^1590 NEXTJ: GOTO 1630 

"1600 A3%=J:REM IF (Al$=LM$(6)) AND (A2$<>IM$(0)) THEN 1560 
1610 IF (A2$=IM$(0)) AND (A3S<>FM$(0)) THEN 1630 
1620 GOSUB 300 : DA(PT%)=A%: RETURN 

1630 GOSUB20 : PRINT" *** ERROR IN CODES *** RE-ENTER" ■ GOTO 1520 ^ 
1640 ' INSERT REAL-TIME CODES 

1650 IF DA(CT%)>=(NR%-2) THEN GOSUB20 : PRINT" DATA ARRAY FULL ~ YOU NEED TO S 
™ NEW ACTIVITY": P RINT" WITH DUPLICATE ID AND EDUCATIONAL ACTIVITY INFO S" 
PRINT" ORDER TO ADD SOME MORE REAL-TIME CODES":GOSUB 150 -RETURN 

T%)!lS B 165 D 0 (CT%):G ° SUB 1510 ^ EF T$ (A$ , 1 )=P$ THEN RETURN ELSE DA(CT%)=DA(C 

1670 'CHANGE REAL-TIME CODES 

1680 PRINT:PRINT" LINE # TO CHANGE" : GOSUBl 90 : IF LEFT$(A$ 1)=P$ THEN RETURN 

im<C&%) ° R ( P ^>^T^DA(CT%))) ?HEN GOsJb o" f PRINT" 
*** INVALID LINE # ***":GOTO 1680 

1700 GOSUB 1890 : PRINT: PRINT" NOW ENTER CHANGE IF ABOVE LINE IS TO BE CORRECTED" 

OSUB ?8°90 UB :GOTO iSo™^ ™ ' ' >?$ ™" ™ *™ ' " cSS DONE --"^G 

1720 'DELETE REAL-TIME CODES 

J 73 ?BETOW (CTX) "° PRINT " S ° RRY ' N ° C0DES ARE AVAILABLE TO DELETE" : GOSUB 15 

1740 PRINT: PRINT" ENTER LINE # TO DELETE - NOTE, IF YOU PLAN TO DEIETF Wpat" 
: PRINT" LINES, BE SURE, TO ENTER THE LARGEST LINE NUMBER FIRST '^PRINT" THE NEXT 
LARGEST SECOND, ETC., SO THAT THE LOWER LINE" : PRINT" NUMBERS ARE UNAFFECTED 
1750 GOSUB 190 : IF LEFT$ (A$ , 1 )=P$ THEN RETURN ARh UNAFFECTED. 

1760 PT%=VAL(A$)+CT% 

D 7 UNeV"oS B 1730° R (m>(Cn+DA(CT%))) THEN G0SUB2 ° =PRINT:PRINT" *** INVALI 

ll 8 f 0 J°^\ m ° :PRINT " 13 ™ IS THE LINE Y0U WISH T0 DELETE?":GOSUB 190 -IF LEF 
T$(A$,1)=P$ THEN RETURN ELSE IF LEFT$ (A$ , 1 )<>"Y" THEN 1730 

1790 FOR J-PM TO (C«+DA(CTZ)-l):DA(J)«DA(J+l):NEXTJ:DA(CW+DA(C«))«0-nAfrTy^ 
DA(CTX)-1: PRINT" *** DELETE DONE ***":GOTO 1730 wuo ia+uaw;T*;;-0. DA(CTa)- 

1800 'LIST ID AND EAS DATA 

1810 GOSUB80 :FOR J-l jTO 6: GOSUB 180 : NEXTJ: GOSUBl 50 

1320 GOSUB90 : FOR J=7 to 19:GOSUB180 : NEXTJ: GOSUB150 

1830 GOSUB90 : FOR J-20 TO 30:GOSUB180 : NEXTJ: GOSUB150 : RETURN 

1840 'LIST RTC DATA \ 
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850 GOSUB100 : PRINTOA$ (Ctt-1) ; DA(CT%-1 ) : PRINTDA$ (CM) ; DA(CT%) : PRINT 
1860 K*CT%+DA(CT%):FOR WM TO K STEP 12: FOR J- 1 TO 1+ I IF J>K THEN 1880 
1870 PT%=J:GOSUB1890 : NEXTJ: GOSUB150 :NEXTI ™ EN 
1880 GOSUB150 : RETURN 
1890 'PRINT CODE LINE 

1900 A%=DA(PT%) : 3OSUB260 : Al$=LM$ (Al%) : A2$= IM$ (A2%) : A3$=FM$ (A3%) 
1910 PRINT" LINE -»;PK-C«i» »;A1$;» ";A2$;" " ; A3$ : RETURN 
1920 'REAL-TIME CODING 
1930 'CHECK ID & EAS VALIDITY 

1940 IF IE XO0 THEN GOSUB120 :GOSUB1280 : IF IEXO0 THEN RETURN 
950 IF EEXOO THEN GOSUB140 :GOSUB1480 : IF EE%<>0 THEN RETURN 
1960 CHECK TO MAKE SURE READING OR MATH CODED 

B 9 [6O IF :TO )>30) ° R (DA(27)=MV%) THEN IF (DA(28)>30) OR (DA(28 )=MV%)THEN GOSU 
1980 CLS: PRINT" ENTER NEW REAL-TIME CODING INFO: "-GOTO 2010 

1990 PRINT: PRINTDA$ (CTZ-1 ) ; " (HHMM)" : GOSUB190 : j-cTX-1 : DA( J)=VAL(A$ ) • GOSUR -520 
0 5I !gOTO (AU<24) (A2%>=0) AN ° (A2K60) THENts^O^lLS^^^ 

2000 PRINT DA$<CT%-1);DA(CT%-1): GOSUB 210 : IF A$="Y" THEN GOTO 1990 RISE rftitrn. 
2010 GOSUB1990 ;G OSUB170 :GOSUB 1640 :GOSUB210 : J A$<>"Y" THEN RETURN 
2020 'MODIFY RTC RETURN 

2030 CLS: PRINT: PRINT" MODIFY REAL-TIME CODES: ": PRINT 
2040 PRINT" I = INSERT A LINE OF CODES" 
2050 PRINT" C = CHANGE A LINE OF CODES" 
2060 PRINT" D = DELETE A LINE OF CODES" 

2070 PRINT" T = CHANGE TIME STARTED FOR REAL-TIME CODING" 

2080 PRINT" L = LIST THE REAL-TIME CODES": PRINT 

2090 GOSUB190 : IF A$»"I" THEN GOSUB 1640 : G OTO 2020 

2100 IF A$="C" THEN GOSUB 1670 :GOTO 2020 

2110 IF A$="D" THEN GOSUB 1720 -.GOTO 2020 

2120 IF A$="L" THEN GOSUB 1840 :GOTO 2020 

2130 IF A$="T" THEN GOSUB 1990 :GOTO 2020 

2H0. if LEFT$(A$,1)=P$ THEN RETURN ELSE GOSUB110 :GOTO2020 
2150 'INSERT NEW ACTIVITY INTO DATA FILE 
2160 IF DF$="NONE" THEN GOSUB 4170 

2170 CLS : PRINT" INSERT A NEW ACTIVITY INTO ";DF$: PRINT 

2180 PRINT'' ID = ENTER NEW IDENTIFICATION INFO OR MODIFY LAST ID" 

2190 PRINT EAS = SAME ID AS BEFORE; ENTER NEW ED. ACTIVITY INFO & SAVE" 

2200 PRINT RTC = SAME ID AS BEFORE; ENTER NEW ED. ACTIVITY INFO" \ 

2210 PRINT" AND REAL-TIME CODES AND SAVE" # 

2220 PRINT"LIST » LIST CONTENTS OF CURRENT ID, ED. ACTIVITY AND" 

2230 PRINT" REAL-TIME CODES" AUHVlli, AND 

2240 GOSUB190 : IF NA%>(AM%-1) THEN GOSUB20 : print" *** ACTIVITY MAX RFAPHFn 

*** DATA FILE FULL" : GOSUB150 : RETURN ALiivirY MAX REACHED 

2250 IF A$="ID" THEN GOSUB 1230 :GOTO 2150 

2260 IF A$="EAS" THEN 2300 

2270 IF A$="RTC" THEN 2320 

2280 IF A$="LIST" THEN GOSUB 1800 : GOSUB 1340 :GOTO 2150 
2290 IF LEFT$(A$,1)=P$ THEN RETURN ELSE GOSUB110 :GOTO 2150 

"!?^^Ub1500 (J>=0:,,EXTJ:GOSUB 1310 ^ »" ™ E » « 

2310 GOTO 2150 

2320 FOR J»7 TO SLl: DA(j)=0: NEXTJ : GOSUB 1310 : IF (IEZ*0) AND (EE&=0) rHPN rrvs.m 
1920 :NAZ-NA3U1:ANX«NA*:GOSIJB2500 ^ °' G0S,JB 

2330 GOTO 2150 

2340 'MODIFY AN OLD ACTIVITY 

2350 IF DF$»"NONE" THEN GOSUB 2940 
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2360 GOSUB2840 : IF LEFT$ (A$ , 1 )=P$ THEN RETURN ELSE GOSUB1210 

2370 CLS:PRINTTAB(12)" MODIFY AN OLD ACTIVITY: ": PRINT 

2380 PRINT" MID ■ MODIFY ID INFO FOR THIS ACTIVITY" 

2390 PRINT" MEAS = MODIFY ED. ACTIVITY INFO FOR THIS ACTIVITY" 

2400 PRINT" MRTC - MODIFY REAL-TIME CODING DATA FOR THIS ACTIVITY" 

2410 PRINT" LIST = LIST ID, ED. ACTIVITY, AND REAL-TIME CODING INFO" 

2420 PRINT" DACT = PERMANENTLY DELETE THIS ACTIVITY FROM DISK STORAGE" 

2430 PRINT:GOSUB190 : IF LEFT$ (A$ , 1 )-P$ THEN PRINT: PRINT" *** DO YOU WANT YOUR M 

ODIFICATIONS OF THIS ACTIVITY" t PRINT" PERMANENTLY SAVED ON DISK ( Y/N)" : GOSUB190 

:IF A$<>"Y"THEN RETURN ELSE GOSUB250O : RETURN 
2440 IF A$="MID" THEN GOSUB1230 :GOT02370 
2450 IF A$="MEAS" THEN GOSUB 1310 :GOTO2370 
2460 IF A$="MRTC" THEN GOSUB 2020 :GOTO2370 
2470 IF A$="LIST" THEN GOSUB18O0 :GOSUB1840 :GOTO2370 
2480 IF A$="DACT" THEN GOSUB 2880 : RETURN 
2490 GOSUB110 :GOTO2370 
2500 'TRANSFER DA TO DF 

2510 K=SL%*(AN%-1):IF K>AM%*SL%-SL% THEN PRINT" ERROR AT 3510 —SEE TED" 1 END 
2520 FOR J=lTOSL%:DF(j+K)=DA(j):NEXTJ 
2530 'ORDER ACTIVITIES IN DF 

2540 FOR J=l TO NA%: BE( J )=DF(SL%*( J-l )+7) : EN( J)=DF(SL%*( J -1 )+29 ):R%(j)-J' NEXTJ* I 
F NA%=1 THEN 2620 ' > 

2330 FOR 1-1 TO (NA%-l):FOR J=l TO (NA*-I):IF BE( J)>BE( J+1 ) THENA=BE(J): BE(j)=BE 

(J+l):BE(J + l)=A:A=EN(j):EN(j)=EN(J + l):EN(J + l)=A:An=R%(J):R%(j)=R%(j + l) :R %(j + i) a 
Al% 

2560 NEXTJ: NEXTI 

2570 ' COMPUTE TRANSITION TIME AND CHECK FOR OVERLAP 

2580 TR*=0:SE%=0:FOR J=l TO (NA%-1):IF BE(J)>EN(J) THEN GOSUB20 :PRINT" *** SE 
QUENCE ERROR *** START TIME. EXCEEDS STOP TIME FOR":PRINT" ACTIVITY #"'R7(J)-" <5 
TART=" ; BE( J) ; " STOP=" ;EN( J) : SE%=SE%+1 ' 
2590 IF EN(J)>BE(J+1)THEN GOSUB20 : PRINT" *** OVERLAPPING ACTIVITIES ERROR *** 
ACTIVITY #";R%(J): PRINT" ENDS AT";EN( J);" BUT ACTIVITY #" ;R%(j+l ); " BEGINS AT" • 
BE(J+1):SE%=SE%+1 ' 
2600 NEXTJ 

2610 IF SE%>0 THEN PRINT: PRINT" THESE ERRORS PREVENT SAVING YOUR DATA FILE ON DI 
SK.":PRINT" YOU MUST RECTIFY THESE ERRORS BY MODIFYING IT. ": PRINT: GOSUB150 : RET 
URN 

2620 DA(7)=DS:DA(29)=DE:GOSUB630 : TR%=DA(30 ) : FOR J=l TO NA% : TR%=TR%-DF ( 100*( j-l 
)+30):NEXTJ y 
2630 GOSUB 2640 : RETURN 
2640 'WRITE DF TO DISK 

2650 PRINT: PRINT" ... NOW SAVING ";DF$;" ON DISK ..."•PRINT 
2660 OPEN"0",l,DF$:PRINT#l,DF$: PRINTS ,CF$:PR^ 

NT#1,TR%:PRINT#1,TN$:PRINT#1,CN$:PRINT#1,DC$:IF NAK=0 THEN GOTO 2710 
2670 FOR J=l TO NA%: K=SL2*(R%( j)-l ) : FOR I=K+1 TO K+CTX: PRINTS 1 , DF( I) : NEXTI 
2680 IF DF(K+CH)=0 THEN 2700 

2690 FOR I=(K+CB%) TO (K+CT%+DF(K+CT%) ) : PRINT#1 , DF( I ) : NEXTI 
2700 NEXTJ v 

2710 CLOSE: RETURN 

2720 ' READ DF FROM DISK 

27 30 'FOR J=l TO AM%*SL%:DF(J)=0:NEXTJ:ON ERROR GOTO 3880 
2740 ON ERROR GOTO 2820 

2750 OPEN"I",l,DF$:INPUT#l,A$:INPUT#l,B$:IF (A$<>DF$) THEN PRINT" *** NOT A VAI 
ID ALTOS FILE ***": GOSUB 150 :GOTO 2800 

2760 CF$ = B$: INPUT#1 ,NA%: INPUT#1 ,DS: INPUTfU ,DE: INPUT#1 ,TR%: INPUT#1 ,TN$: INPUT#1 CN 
$: INPUTS 1,DC$: IF NA2<«0 THEN GOTO 2800 

2770 FOR J«l TO NA#: K=SL%*( J-l ) : FOR I=K+1 TO K+CT#: IF EOF(l) THEN 2810 ELSE INPU 
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T#l ,DF( I) , NEXTI: IF DF(K+CT2>0 THEN 2790 

2780 FOR I-(K+CBZ) TO (K+CT?+DF(K+CT%)) : IF EOF(l) THEN 2830 ELSE INPUT#1 , DF( I) : N 
EXTI 

2790 NEXTJ 

2800 CLOSE: ON ERROR GOTO 3550 : RETURN 

2810 NAZ-J-1: PRINT" EOF PREMATURELY ENCOUNTERED AFTER ACTIVITY #"• NA% • PRINT" DAT 
A HAVE BEEN J£&T AFTER THIS ACTIVITY. ":G0SUB150 : GOTO 28 00 

c?, 20 SIST^P 3550 :IF ERR / 205 3 THEN 3550 ELSE PRINT " FILE NOT FOUND": RE 
SUME 2800 ' 

2830 PRINT" EOF ENCOUNTERED IN DATA FILE - SEE TED": GOSUBI50 :GOTO2800 
2840 'FIND AN ACTIVITY 

2850 PRINT: PRINT" SPECIFY THE TIME STARTED FOR THE ED. ACTIVITY YOU"- PRINT" WANT 
TO FIND ":GOSUB190 : IF LEFT$ (A$ , 1 )=P$ THEN RETURN ELSE IF A$=NU$ THEN 2850 

X™ fv^ L(A$):F ° R J "i T ° NA%:IF A ^DF((j-l)*SL% + 7) THEN AN%=J: RETURN 

2870 NEXTJ: PRINT: PRINT" TIME NOT FOUND - USE 24 HR. NOTATION FOR P.M. HRS.":GOT 

O 2ojU 

2880 'DELETE A SUBFILE IF DF 

2890 GOSUB 1800 :GOSUB1840 ^ 

2900 PRINT: PRINT" ARE YOU SURE THIS IS THE ACTIVITY YOU WAN T ) TO DELETE?" : GOSUB19 
0 :IF LEFT$(A$,1)<>"Y" THEN RETURN w*>uiii* 
2910 IF AN%=NA% THEN 2930 

lln M*y ilf? 1° NA%:K»SL%*(J-1):F0R 1=1 TO SL%:DF(K + l)=DF(K + I + SL%):NEXTI:NEXTJ 
2930 NA/.=NA/.-l: PRINT: PRINT" *** ACTIVITY DELETED ***": GOSUB 2530 • RETURN 
2940 'FIND A DF 
2950 GOSUB 3020 

2960 GOSUB3110 : PRINT: PRINT" WHAT IS THE NAME OF THE DATA FILE YOU WANT TO RETRI 
EVE?":GOSUB190 : IF LEFT$ (A$ , 1 )=P$ THEN RETURN ELSE IF A$=NU$ THEN 2960 
2970 FOR J=l TO FC%: IF A$=FL$(J) THEN 2990 

2980 NEXTJ: PRINT" FILE NOT FOUND IN CATALOG" :GOSUB150 :GOTO2960 
2990 DF$=A$: GOSUB 2720 : RETURN 
3000 'DELETE A DF 

3010 PRINT" HERE IS WHERE DELETE GOES":GOSUB150 : RETURN 
3020 'READ FILELIST 

N°3050 N ERR ° R G0T ° 3 ° 6 ° :FC%a,0:OPENMl "» 1 ' MFIL ELIST":FOR J=l TO MF%: IF EOF(l) THE 

3040 INPUT#1,FL$(J):FC%=FC%+1:NEXTJ 
3050 CLOSE: ON ERROR GOTO 3550 : RETURN 

3060 ON ERROR GOTO 3550 : IF ERR/2053 THEN 3550 ELSE PRINT" FILELIST NOT FOUND" 
: RESUME 3050 

3070 'WRITE FILELIST TO DISK 

3080 OPEN"0 ',l,"FILELI?r-":FOR J=l TO FC*: IF FL$(J)="0" THEN 3100 
3090 PRINT#1,FL$(J) 
3100 NEXTJ: CLOSE: RETURN 
3110 'PRINT FILELIST 

nONlvl^/M^s!"^^ 5 -■"*<>™™™V CATALOG OF EXT STING OBSERVA 
3140 'PRINT DF 

3150 LPRINT CHR$(12):POKE &HFC05.0 

3160 L=2:GOSUB60 :GOSUB3320 : FOR 1=1 TO NA%:AN%=I:GOSUB1210 :GOSUB3190 
3170 GOSUB3230 : IF DA(CH)>0 THEN GOSUB 3290 
3130 NEXTI: L=2: GOSUB3370 : RETURN 
3190 ' PRINT ID 

3200 LPRINTCR$: LPRINT" ******* IDENTIFICATION DATA ";STRIN'G$(35 ,"*"): LPRINTCRS* F 

OR J=l TO 6: IF DA(J)>0 IHENGOSUB30 :G0TO3220 

3210 LPRINTDA$ ( J ; ; " -";TAB( 34) ; DA( J) ;" -—MISSING DATA " 
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3220 NEXTJ: LPRINTCR$ : RETURN 
3230 "PRINT EAS 

3240 LPRINTCR$: LPRINT" ****** EDUCATIONAL ACTIVITY DATA ****** ACTIVITY #»-AKi7. 
LPRINTCR$ V 1 ff ,m/ " 

3250 FOR J=7 TO 30: IF DA(J)>0 THEN GOSUB 30 :GOTO3280 
3260 IF (J=28)OR(J=19)OR((J>20)AND(J<=26))OR((J>10)AND(J<=16)) THEN 3280 

3270 LPRINT DA$(J);" - " ; TAB( 34 ) ; DA( J) ; " MISSING DATA » 

3280 NEXTJ: RETURN 
3290 'PRINT RTC DATA 

3300 L=1:GOSUB60 : LPRINTCR$ : LPRINT" ****** REAL-TIME CODING DATA ****** ACTIVI 
TY # ; AN%:«LPRINTCR$ : LPRINT DA$ (CT%-1 ) ; DA(CT%-1 ) : LPRINT DA$(CT%) ;DA(CT£) : LPRINTCR 
y 

3310 K=CT7. + DA(CT%):FOR J=CBZ TO K: PT%= J : GOSUB50 : NEXTJ: L=l :GOSUB3370 : RETURN 
332U PRINT HEADER 
3330 LPRINTCR$,CR$ 

3340 LPRINT" OBSERVATION SYSTEM - ";CF$: LPRINT" DATA FILE NAME - ":DF$- LPRINTCRS 
: LPRINT" TOTAL # OF ACTIVITIES =";NA%;" TRANSITION TIME =" ; TR% : LPRINTCR$ J LPRI 
NT" TARGET STUDENT NAME - "; TN$ : LPRINT" CODER NAME - CN$ : LPRINT" COMMENTS - "• 
DC y * 

3350 LPRINTCR$: LPRINT" DAY START TIME:";DS;" DAY END TIME- "-DE 
3360 LPRINTCR$: RETURN 
3370 ' PRINT RTC SUMMARY 

3380 LPRINTCR$: LPRINT" *** REAL-TIME CATEGORY SUMMARY ***": LPRINTCRS 
3390 IF L=l THEN LPRINT TAB(10);"(FOR THIS ACTIVITY)" 
3400 IF L=2 THEN LPRINT TAB( 10 ) ; " (FOR ALL ACTIVITIES)" 
3410 LPRINTCR$: LPRINT TAB( 7)" FREQUENCY" ;TAB( 22): "PERCENT" 
3420 LPRINT TAB( 7 ) ; "- ";TAB(22);" ":LPRINTCR$ 

3430 TC%=0:FOR j«l TO 7: TC%«TCZ+LM%( J, L) : NEXTJ: IF TC%=0 THEN LPRINT" — NO REAL 
-TIME CODES THIS DAY ": RETURN 

^?2oS!L J r 1 T ° 7:LPRINT ^(J^TABdOJsLMXCj.LJsTABCaD^LM^J.Lj/TC^jMOO^EXT 
J » LPRINTCRy 

3450 FOR J=0 TO 7:LPRINT IM$ ( J) ;TAB( 10 ) ; IM%( J , L) ;TAB( 21 ) ; ( IM%( J, L) /TC%)*100 : NEXT 
J J LPRINTCRy 

3460 FOR J*0 TO 2:LPRINT FM$ ( J) ; TAB( 10 ) ; FM%( J, L) ;TAB( 21 ) ; (FM%(.J, L) /TC%)*100 : NEXT 
J :LPRINTCR$: RETURN ' 
3470 1 USE AUX. PRINTER 

3480 CLS: PRINT: PRINT" IS THE AUXILLIARY PRINTER HOOKED UP TO THE RS-232 AND POWE 
R ON?":GOSUB190 : IF LEFT$ (A$ , 1 )<>"Y" THEN RETURN 
3490 POKE &HFC00,72 

3500 POKE &HFC01,60:POKE &HFC02 ,6: POKE & HFC 04 ,0: POKE &HFC05 ,0: POKE &HFC06 0-POKE 
&HFC07,0:POKE 16421, 2:POKE 16422, 9:POKE 16423,252 wo ,u. rows 

3510 PRINT:PRINT" CHECK THE AUXILLIARY PRINTER FOR A MESSAGE. ..": LPRINT" *** AUX 
ILLIARY PRINTER READY ***": LPRINT CHR$(12) AUX 
3520 RETURN 

3530 LPRINT" CONTENTS OF DF" : FOR J-l TO NA%*SL%: LPRINT J; "-" ; DF( J) : NEXTJ: END 

3540 LPRINT" CONTENTS OF DA" : FOR J=l TO SL7.:LPRINT J; "-" ; DA(i) : NEXTJ- END 

3550 CLOSE:PRINT"ERROR#";((ERR/2)+l);" AT" ; ERL: PRINT" (SUB 1 IF>49)" 

3560 IF ERR/2=61 THEN PRINT" *** WARNING *** THIS ERROR MEANS THAT YOUR DISK IS 

FULL. : PR INT YOU CANNOT CREATE ANY MORE FILES ON THIS DISK .": PRINT" YOU CAN HO 

WEVER, MODIFY EXISTING ONES.": END ' 

35 70 END 

3580 ON ERROR GOTO 3550 : CF$="N0NE": DF$="NONE": LC$="CODE" : NC$="CARTL0" : D$-"UNSPE 
C 1 1 IE D 

3590 CN$»D$:TN$-D$:DC$»D$ 

3600 MF^48:P$=".":AM%=25:CR$=CHR$(13):NI^6:NE^24:NR^70:NU$= MV%»- 99- ctt=32 

:CBt-33:ANl-0:NAX-0:SLX-lOO:DIM DA(SLX) I DA$(CTX) , DF(SL**AM%) ,BE(AM%) ,EN(AM%) \%( 
AM%),FL$(MF%),PJ%(30),PJ$(87),LM$(7),IM$(7)^ 



3610 DEFINT I-L 

3620 FOR J= 1 TO CT%: READ DA$(J):NEXTJ 

3630 DATA OBSERVATION DATE (MMDDYY) 

3640 DATA OBSERVER # 

3650 DATA TEACHER # 

3660 DATA TARGET STUDENT # 

3670 DATA CLASS TYPE (1-4) 

3680 DATA CLASS SIZE (1 - 999) 

3690 DATA TIME STARTED (HHMM) 

3700 DATA # STUDENTS IN SAME ACTIVITY 

3710 DATA TS PACING 

3720 DATA TS ACTIVITY (1-7) 

3730 DATA TS ACTIVITY -2ND 

3740 DATA TS ACTIVITY -3RD 

3750 DATA TS ACTIVITY -4TH 

3760 DATA TS ACTIVITY -5TH 

3770 DATA TS ACTIVITY -6TH 

3780 DATA TS ACTIVITY -7TH 

3790 DATA TS TASK DIFFICULTY (1-3) 

3800 DATA TS INSTRUCTOR (1-6) 

3810 DATA TS INSTRUCTOR (EXTRA) 

3820 DATA INSTRUCTOR ACTIVITY (1 - 7) 

3830 DATA INSTRUCTOR ACTIVITY -2ND 

3840 DATA INSTRUCTOR ACTIVITY 0 -3RD 

3850 DATA INSTRUCTOR ACTIVITY °-4TH 

3860 DATA INSTRUCTOR ACTIVITY -5TH 

38 70 DATA INSTRUCTOR ACTIVITY -6TH 

3880 DATA INSTRUCTOR ACTIVITY -?TH 

3890 DATA CURRICULUM CONTENT - PRIMARY 

3900 DATA CURRICULUM CONTENT - SECONDARY 

3910 DATA TIME STOPPED (HHMM) 

3920 DATA ALLOCATED TIME (MIN'S) 

3930 DATA TIME STARTED REAL-TIME CODING 

3940 DATA # OF REAL-TIME CODES 

3950 FOR J=l TO 7: READ LM$(J):NEXTJ 

3960 DATA EW,EO,EC ,ED,NI,NW,NO 

3970 FOR J=0 TO 7: READ IM$(J):NEXTJ 

3980 DATA NU£M,AF,AQ,XN ,XP ,SD ,TF 

3990 FOR J=0 TO 2: READ FM$(J):NEXTJ 

4000 DATA NU,TS,GR 

4010 FOR J=l TO 30: READ PJ%(j):NEXTJ 

4020 DATA 0,0,0,0,1,0,0,0,5,7 

4030 DATA 7,7,7,7,7,7,14,17,17,23 

4040 DATA 23,23,23,23,23,23,30,30,0,0 

4050 FOR J=l TO 87: READ PJ$(J):NEXTJ 

4060 DATA REGULAR , RESOURCE , SELF-CONTAINED , OTHER 

4070 DATA SELF-PACED , OTHER-PACED 

4080 DATA ORAL READING , SILENT READING , RECITING , LISTENING , DISCUSSING , WRITING ,OTHE 
M 9 £tfkS^ B ^^rSS^xS£ RD \"^ mR - M «. AIOB ,8«l^-m™tK5XiOifAl. MATERIALS, TEACHI 
tfL^A^^^ 

Ji?!L D iI A DEC0DING/PH0N ICS > WORD STRUCTURE .WORD MEANING , COMPREHENSION , READING PRA 
G BELOW TE^ ITION/CREATIVE WRITING .READING RELATED-OTHER , READIN 

4130 DATA ADDITION/SUBTRACTION-NO REGROUPING ,ADD IT ION/ SUBTRACTION-REG ROUP ING , COM 



PUTATIONAL TRANSFER, PLACE VALUE /NUMERALS .MULTIPLICATION , DIVISION .FRACTIONS/ DEC IM 
ALS, SPATIAL APPLICTION .VERBAL APPLICATION .MATH RELATED-OTHER, MATH BELOW TEST LEV 
EL q 

4140 DATA UD#UD,UD,UD,UD,UD,UD,UD,UD 

4150 DATA PHYSICAL/BIOLOGICAL SCIENCES .SOCIAL SCIENCES .FOREIGN LANGUAGE UD UD UD 

,UD,UD,UD,UD,ART,MUSIC, TECHNOLOGICAL ARTS .PHYSICAL EDUCATION .PERCEPTUAL DEVELOPM 

ENT, MANAGEMENT/PROCEDURAL, RECREATION/BREAK, PERSONAL EXPERIENCES/FEELINGS OTHER 
4160 GOTO 760 

4170 REM-TO LABEL A NEW DATA FILE XXXXX. YYYYYY 
4180 GOSDB3020 

4190 CLS:?RINT: PRINT" INSTRUCTIONS ON LABELING" : PRINT" 

: PRIN I 

4200 PRINT" A DATA FILE NEEDS A UNIQUE LABEL IN ORDER TO IDENTIFY": PRINT" IT FOR 
SUBSEQUENT USE. THE LABEL, OR NAME, HAS TWO PARTS": PRINT" SEPARATED BY A PERIO 
D • • PRINT 

4210 PRINT" THE FIRST PART OF THE LABEL MUST BE ONE WORD CONSISTING":PRINT" OF N 
0 MORE THAN 8 CHARACTERS, WITH NO EMBEDDED BLANKS": PRINT" OR PERIODS OR SLASHES 
. THE FIRST CHARACTER CANNOT BE" 
4220 PRINT" A NUMBER. " : PRINT: GOSUB150 
4230 CLS: PRINT: PRINT 

4240 PRINT" THE SECOND PART OF THE LABEL (AFTER THE PERIOD) IS THE": PRINT" NAME 
OF THE OBSERVATION SYSTEM WITH WHICH THE DATA FILE" : PRINT" IS TO BE ASSOCIATED. 

THE TWO PARTS MUST BE SEPARATED" 
V4250 PRINT" BY A PERIOD. E.G. , 'MARCH4. PROBING' IS A VALID DATA" : PRINT" FILE LA 
BEL. THE FIRST PART, MARCH4, UNIQUELY IDENTIFIES" : PRINT" THE DATA FILE, AND THE 

REMAINDER INDICATES WHICH" 
4260 PRINT" OBSERVATION SYSTEM IT BELONGS WITH. ": PRINT: PRINT" WHAT IS THE LABEL 
FOR YOUR NEW DATA FILE?":GOSUB 190 

4270 IF LEFT$(A$,1)=P$ THEN RETURN ELSE IF A$»"" THEN 4190 • 

4280 Z$=A$:GOSUB 4450 : IF C0%»-1 THEN 4190 : REM TO SPLIT LABELINTO 2 PARTS 

4290 GOSUB 4340 : IF C0%=-1 THEN 4190 

4300 B$-Z$: CLS: PRINT" IS ";B$;" THE NEW LABEL YOU WANT TO PERMANENTLY USE": PRINT 
^FOR YOUR NEW DATA FILE?":GOSUB 190 : IF LEFT$(A$ , 1 )=P$ THEN RETURN ELSE IF A$= 
THEN 4300 

4310 IF LEFT$(A$,1)<>"Y" THEN 4190 

4320 CF$-CX$ : DF$f Z$ : NA%=0 : TRZ=0 : TN$-"UNSPEC IFIED" : CN$=TN$ : DC$=TN$ : DS=0 : DE«0: GOSU 
B1030 : GOSUB 2640 

4330 FC%=FC%+1:FL$(FC%)=DF$:GOSUB3070 : RETURN 

4340 REM-SUB TO TEST VALIDITY OF LABEL FOR TRSDOS FILE NAME 

4350 CO%=-l:IF LEN(A$)>8 THEN 4440 

4360 I=ASC(MID$(A$,1,1)): IF I>=48 AND I<=57 THEN 4420 * 

4370 FOR J=l T"0 LEN(A$): B$=MID$(A$ ,J, 1 ): I»ASC(B$): IF ( I>-48 AND I<=57) OR (l>=65 

AND I<=90) THEN NEXT J ELSE GOTO 4430 
4380 FOR J=l TO FC%i I=INSTR(*L$ (j) ,P$ ) : IF I>0 -THEN B$=MID$(FL$(j) ,1 ,1-1 )' ELSE B$ 

4390 IF B$»A$ THEN 4410 ELSE NEXT J 

4400 CO^ + l: PRINT: PRINT Z$;" IS A VALID AND UNIQUE FILE LABEL. " : PRINT' RETURN 
4410 CLS: PRINT: PRINT" A FILE WITH THIS LABEL ALREADY EXISTS - DUPLICATES" • PRINT" 

ARE NOT ALLOWED. ":GOSUB150 :GOSUB3110 : RETURN 
4420 PRINT: PRINT" LABEL CANNOT BEGIN WITH A NUMBER -"; LEFT$(A$ , 1 ): GOSUB 150 -RE 
TURN 

.4430 PRINT: PRINT" LABEL HAS AN INVALID IMBEDDED CHARACTER = ":B$:GOSUB 150 -RET 
URN 

4440 PRINT: PRINT" LABEL HAS MORE THAN 8 CHARACTERS - NOT ACCEPTABLE" : GOSUB 150 
: RETURN 

4450 C02— l:FOR J*l TO LEN(A$): IF MID$(A$,J,1)*P$ THEN 4460 ELSE NEXT JiPRINT"* 
** INVALID LABEL *** PERIOD IS MISSING.": GOSUB 150 : RETURN 
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4460 CX$»MID$(A$,J+l,LEN(A$)):A$»MID$(A$,l,J-l):FOR J-l TO FCMF CX$=FL$(J) THE 
N 4470 ELSE NEXT J: PRINT" *** ERROR *** "}CX$;" WAS NOT FOUND IN YOUR CATALOG A 
8": PRINT" AN OBSERVATION SYSTEM LABEL" : GOSUB 150 ' : RETURN 
4470 COZ-lt PRINT: PRINTCX$;" IS A VALID OBSERVATION SYSTEM LABEL. ": RETURN 
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SAMPLE DATA FILL 



1 



OBSERVATION SVSTEN - ALTOS 
DATA FILE NAME - Ml 2501 .ALTOS 

TOTAL # OF ACTIVITIES - 16 

TARGET STUDENT NAME - TINA 
CODER NAME - ClK. FOREMAN 
COMMENTS - UNSPECIFIED 



TRANSITION TIME « 21 



DAV START TIME: 827 



DAV END TIME: 1400 



******* I DENT I F I CAT I ON DATA **^******************************** 



OBSERVATION DATE <MMDDW> - 
OBSERVER # - 
TEACHER # - 
TARGET STUDENT # - 
CLASS TVPE O - 4> - 
CLASS SIZE a - 9995 - 



31281 
4 
11 
1 

12 



SELF-CONTAINED 



iwws* EDUCATIONAL ACTIVITY DATA ****** ACTIVITV #. 1 



TIME STARTED '!HHMM> - 

ft STUDENTS IN SAME ACTIVITV - 

TS PACING - 

TS ACTIVITV a -7) - 

TS TASK DIFFICULTY <1 - 3) - 

TS INSTRUCTOR <1 - 6'J - 

INSTRUCTOR ACTIVITV <1 - 7> - 

CURRICULUM CONTENT - PR I MAR V - 

TIME STOPPED <HHMM> - 

ALLOCATED TIME <MIN'S> - 



o 

r 

12 

0 * 

4 i 

1 « 



crr*t 
•JO 



' OTHER-PACED 
= LISTENING 

" NO*" INSTRUCTOR 
* SUPERVISING 
- OTHER 



:f::.|.i***** I DENT I F I CAT I ON DATA ••f'**H■:*^H:t::|;**:t::+::+"■l■:****:t:***:♦::+:**:♦^•fv.^:+:;+.•:+::^.::+::+: 



OBSERVAT I ON DATE < MMDDVV > 
OBSERVER - - 
TEACHER # - 
TARGET STUDENT # 
CLASS TVPE < 1 - 4->- - 
CLASS SI2E <1 ~ 999::' - 



4 

11 

1 

3 = SELF-CONTAINED 
12 



»«t**** EDUCATIONAL ACTIVITV DATA ****** ACTIVITV #'2 



..u 

mJ 

00 

< 



TIME STARTED <HHMM> - 

« STUDENTS TN SAME ACTIVITV 

T" PACING - 

TS ACTIVITV a - 7> - 

TS ACTIVITV -2ND 

TZ TASK DIFFICULT',' CI - 3: 

TS INSTRUCTOR <i - eO - 

INSTRUCTOR ACTIVITV a - 7> • 
r • ^TURRICULVN CONTENT -■ PRIMARY 
EWCriME STOPPED <HHMM> - 
" ' i r rarer-, TTMP i- , MTN ,, '"'j - 



340 

10 

1 



1 * 

6 « 

•* 

10 « 

©51 

11 



Lt' E L F ~* ■ P R l« E D 
WRITING 

SILENT READING 
EftSV 

NO INSTRUCTOR 
SUPERVISING • 
* DECODING/PHONICS 



303 



c 



***:**:•< REAL-T I HE CODING DATA ****** ACT I UI TV # 2 

TIME STARTED REAL-TINE CODING P4Q 
# OF REAL-TINE CODES 12 



1 


- ED 


SD 


GR 


«*L» 


- ED 


SD 


GR 




- EUI 


NU 


NU 


4 


- EU 


NU 


NU 




- EW 


NU 


NU 


6 


- EW 


NU 


NU 


i 


- EUI 


NU 


NU 


o 
o 


EUI 


NU 


NU 


9 


- EC 


NU 


NU 


I© 


- El..', 


NU 


NU 


.11 


- NO- 


' NU 


NU 


t -i 

i. 4* 


- EW 


SD 


GR 



*** REAL T I HE CATEGORY SUMMARY *** 

(FOR THIS ACTIVITY) 
FREQUENCY PERCENT 



EUI 8 66 . 6667 . S*i 

EO 0 0 *C 

EC .1 



NU 9 

AH 0 8 

AF 8 u 

f\0. 0 0 

;-;n 0 0 

MP 8 0 

SD' 3 

TF O 0 



NU 9 75 

TS 0 Q 

-.BT 

Ui'. \J J 



5 
3 



.;:)•:;***««* I DENT I F I CAT I ON DATA *******************************!**** 



OBSERVATION DATE MNDDW) - 31281 

OSSEftVER fr •• 4 

TEACHER i? • 14 

TARGET STUDENT # 1 

l LASS TYPE a - 4> - 4 ■ OTHER 

CLASS SIZE •'.L ••- 999 > - 11 



304 



9 

ERIC ****** EDUCATIONAL ACTIVITY DATA ****** ACTIVITY # 3 



f 



TIME STARTED «,HHMM> 

# STUDENTS IN SAME RCTIUI'TY - 

TS PACING - 

T3 ACTIUITY a - 7> - 

TS ACT I U IT V -2ND - 

TS TASK DIFFICULTY <t - 3> - 

TS INSTRUCTOR a - 6> - 

INSTRUCTOR BCTIUITV <1 - 7) - 

INSTRUCTOR ACT IU I TV -2ND - 

CURRICULUM CONTENT - PRIMARY - 

TINE STOPPED <HHMM> 7 

ALLOCATED TIME WIN'S) - 



831 
11 

2 « OTHER-PACED 

3 - RECITING 

1 * ORAL READING 

2 ■ MEDIUM 
1 = TEACHER 

3 - PROMPTING 

4 ■ MODEL I NG^DEMQ 
16 « GRAMMAR 

18 



: |: :•!<!+!:+ 


•** REAL-TIME CODING DATA 


:4c ftPTTUTTV 
nL' 1 X v X 1 1 


Tli'lE 


STARTED REAL-TIME CODING 851 




# OF 


REAL-TIME CODES 19 




.1 


• ED 


SD GR 






ED 


SD GR 






ED 

mm mi, 


SD GR 

MM I-. f*-». 




4 - 


EO 


bD UR 
AQ GR 








flr*i hp 

1 I'm"? »-jr-. 






EO 


AQ GR 






EC 
EO 


NU NU 
AF TS 




18 - 


EC 


AF GR 




11 - 


EO 


AQ GR 






ED 


AF GR 




13 - 


EC 


AF GR 




.14 - 


MM* M» 

EU 


AQ GR 




13 


EC- 


AQ GR 




* 16 - 


EC 


AF GR 




j T 


EO 


AQ GR 




.1. O 


EO 


AQ GR 




19 - 


EO 


AQ GR 






REi r 


Yl-TINE CATEGORY SUMMARY 








<FOR THIS ACTIUITY;' 








EQUENCY PERCENT 




Da' 




6 O 




u. \J 




9 47 m 36*34 

tr "!• I rr.-, 

X.C< n 1 •«."„! 




1 i J. 

■ ;i j 




Kf ■*..» T 1 8»0 

0 0 

© ' ■ 0 








0 0 

1 -j 4 ^S'-' 1 to 




;*.!•! 




0 0 




r-iC: . 




9 47.3684 




0 ;.n 
ERLC ;p 




0 0 
0 0 


305 


I'D 




4 21.0326 





o 

I— 
00 



TF 

HU 
TS 

GR 



0 

i 

1 

17 



0 

5.26316 
5.26316 
89.4737 



I******* I PENT I F I CRT I ON DATA *********************************** 



OBSERVATION DATE <MNDDYY> - 
OBSERVER # - 
TEACHER # - 
TARGET STUDENT # - 
CLASS TYPE <1 - 4) - 
CLASS SIZE a - 999 > - 



31281 
4 
11 
1 

3 = SELF-CONTAINED 
12 



.:«***** EDUCATIONAL ACTIVITY DATA ****** * ACTIVITY #4 



TIME STARTED <HHMM) - 

# STUDENTS IN SAME ACTIVITY 

TS PACING - 

TS ACT I VI TV a -7) - 

TS TASK DIFFICULT',' <1 - 3> - 

TS INSTRUCTOR <i - 6> - . 

INSTRUCTOR ACTIVITY <1 - 7) - 

CURRICULUM CONTENT - PRIMARY 

TIME STOPPED <HHMM> - 

ALLOCATED TIME CHIN'S) - 



910 

-99 ■ 

■-99 • 

-•99 ■ 

-99 - 

-99 • 

-99 - 

-99 ■ 

102G 

70 



-MISSING DATA— 
-MISSING DATA— 
•MISSING DATA— 
-MISSING DATA— 
-MISSING DATA— 
-MISSING DATA— 
-MISSING DATA— 



UJ 
3 



£2 

CO 



:|::+:H-::+::t::+::« I DENT I F I CAT I ON DATA *********************************** 



OBSERVATION DATE CMMDDVY) - 
OBSERVER # - 
TEACHER # - 
TARGET STUDENT # - 
CLASS TYPE <1 - 4.":' - 
CLASS SIZE <1 - 999 > - 



31231 



4 
11 



12 



SELF-CONTAINED 



>«**'*** EDUCATIONAL ACTIVITY DATA ****** ACTIVITY # 5 



•IMj - 



1. 1 



TIME STARTED 

# STUDENTS IN SAME ACTIVIT 
TS PACING - 
TS ACTIVITY <1 - 7:> - 
TS ACTIVITY -2ND r 
TS TASK DIFFICULTY a - 3> - 
TS INSTRUCTOR <1 - 6> - 
INSTRUCTOR ACTIVITY <l - 7\> - 
CURRICULUM CONTENT - PRIMARY - 
TIME STOPPED CHHMI'D - 
ALLOCATED TIME k'AXU'S'j - 



1020 
1 

i = SELF-PACED 

1 ~ OPAL READING 
6 * WRITING 

2 --- MEDIUM 

3 ~ AIDE ■ 

3 ~ PROMPTING 



.13 * 

1050 

30 



COMPREHENSION 



t ..-t::,..:h:i«f; REAL-TIME CODING DATA *n-:ti*** ACT. I VI TV 5 



ERIC 



TXi\£ STARTED REAL-TIME CODING i020 
.it OF REAL-TIME CODES 29 

i - ED SD TS 



306 



c 

e 



c 







RF 


rc, 




- EO 


RF 


i «*»' 


4 


•- EO 


FlF 


TS 


5 


- EO 


RF 


TS 


to 


- EO 


RF 


TS 




- EO 


RF 


TS 


8 


~ EO 


RF 


TS 


9 


- EO 


RF 


TS 


io 


— EO 


hF 


TS 


X X 


- EO 


RM 


TS 


12 


~ EO 




TS 


1 T 


--£0 


flt'L 


TS 


14 


- NW 


NU 


NU 




NW 


NU 


NU 


16 


~ 1T.U 


AM 


TS 


X i* 


- HI 


FlF 


TS 


1 O 


~ ED 


SD 


TS 


19 


K.U 


RF 


T'~ 


28 


•- EO 


RF 


TS 


21 


EO 


RM 


TS 




- EO 


RM 


TS 


2^ 


- HW 


Ni I 


NU 


'7 tl 




l Vw.' 






- EO 


NU 


NU 


2u 


- NO 


NU 


NU 


.i!h 1 




NU 


NU 


.... .J 




NU 


NU 






NU 


NU 



BEST COPY AVAILABLE 



REiiL-TIME CFlTECORV SUMMRRV *** 
<FOR THIS ftCTIUITV) 





FREQUENCY' - 


PERCENT 






1 








13 
0 


• 62.069 

0 


e 


i ;1 


T 

1 


18.3448 
3.44828 




1 » v.» 




18.3448 


c 


;\C 


—y 
•„l 


18. 3448 




NU 
f.i'l 


9 
5 


31 . 8345 
17.2414 


c 


,":F 

riO 

i* *i I 


13 

0 

0 


.1 .'I /- « L "* 
t J 

0 


c 


, ,r 


0 


0 




'2D 


■"*!■ 


6- 89655 




rr 
i » 




u 




NU 


9 


■M H 0^43 




TS 
GR 


0 


fey « 9b55 

0 . 





ERJC :f ****** . I DENT I F I CRT I ON DfiTft *«*i*H«**ii«H<**^i^*^***^«*is*i**^^*****:H*«*i* 

«0 aii'llim'-HJ 



OBSERUflT I Of I DATE < MMDDVV > 
OBSERUER - 
TEACHER # - 
TARGET STUDENT # - 
CLRSS TVPE <1 - 4::- - 
CLASS SIZE <1 ~ 399) - 



3 1 2iSl 
4 
11 
1 

3 = SELF-CONTAINED 
12 



****** EDUCATIONAL ACT I UI TV DATA ****** flCTIUITV # 6 



TIME STARTED (HHMM) - 

# STUDENTS IN SAME ACTIVITY - 

TS PACING - 

TS ACT I UI TV <1 - 7> - 

TS TASK DIFFICULTY <1 - 3) - 

TS INSTRUCTORS 1 — 

INSTRUCTOR ACT I UI TV <1 - 7> - 

CURRICULUM CONTENT - PRIMARY - 

TIME STOPPED <HHMM> - 

ALLOCATED TIME (MIN'S) - 



1058 
-99 ■ 
-99 ■ 



-MISSING 
-MISSING 



-99 MISSING 

-99^ ——MISSING 
-99 —-MISSING 

-99 MTSSING" 

-99 MISSING 

1135 

45 



DATA- 
DATA- 
DATA- 
DATA- 
DATfl- 
DflTA- 
DATA- 



******* I DENT I F I CAT I ON DATA ****:^*******:ti**s*!******************* 



OBSERUATION DATE < MMDDVV > - 
OBSERUER -• 
TEACHER # - 
TARGET STUDENT # - 
CLASS TVPE <1 - 4> - 
CLASS SIZE CI - 999 ) - 



3i2Sl 
4 
11 
1 

12 



SELF-CONTAINED 



****** EDUCATIONAL ACT I UI TV DATA m-:***** flCTIUITV # 7 



TIME STARTED (HHMftt ~ 

ft STUDENTS IN SAME flCTIUITV ™ 

TS PACING - 

TS ACT IU I TV U - 7> - 

TS flCTIUITV -2ND - 

TS flCTIUITV -3RD - 

TS TASK DIFFICULT'/ a - 3> - 

TS INSTRUCTOR <i - 6'> - 

INSTRUCTOR flCTIUITV <i 7> •■ 

CURRICULUM CONTENT - PRIMARY - 
TIME STOPPED (HHMM:.' - 
ALLOCATED TIME U'IIN"S> 



1137 
1 

1 « SELF-PACED 

1 ~ ORAL READING 

2 m SILENT READ M4G 
6 » WRITING 

2 « MEDIUM 

6 » NO INSTRUCTOR 

6 » SUPERUISING 

12 « WORD MEANING 

1 1 -\? 

10 



REAL TIME CODING DATA ****** flCTIUITV # 7 



TIME STARTED PEAL TIME CODING 11 



OF REAL-T4ME CODES iu 



L -• 



: 9, 



i£W NU NU 

ZW Ai l TS 

~W NU MU 

GUI NU ill) 

r!I r-.r TS 

Ed AO TS 

Zui iiu NU 

ED i iU NU 

SU MU MU 



308 



BEST COPY AVAILABLE 



IS - EG NU NU 

*** REAL -T I HE CATEGORY SUMMARY *** 
<FQR THIS ACT I VI TV > 
FREQUENCY PERCENT 



BEST COPY AVAILABLE 



EW 


.•» 

to 


Aft 


EG 




2© 


c.~ 

Cw 


0 


0 


ED 

twin* 


1 




HI 


1 


, 10 


Ml.i 


Kl 


0 


Kin 




8 


NU 


7 


78 


AH 


■ 1 


18- 


AF 


1 


18 


AO 

y.H 


1 

8 


18 

0 


VP 
SD 
TF 


0 
0 
0 


8 
8 
8 


NU 


7 


78 


TS 




38 


GR 


0 


8 



. !■:: HHtHOf«:|«Hl I DENT 1 F I CRT I ON DATA ****************:+::+::|^ 



OBSERVflT I ON DRTE < MMDDVV > 
OBSERVER # - 

TEACHER # 

TARGET STUDENT tt - 
CLASS TVPE a - 4) - 
CLASS SIZE < 1 - 999 > - 



31281 
4 
11 
1 

3 ■ SELF-CGNTR I NED 
12 



•i,***** EDUCRT I ONRL RCTIVITV DATA ****** flCTIVITV # 8 



■ TIME STRRTED <HHMM> - 
it STUDENT'S IN SAME RCTIVITV 
TS PACING 

TS RCTIVITV a - 
TS TASK DIFFICULTY <1 - 30 - 
TS INSTRUCTOR <X - 6> - 
iiiJTRUCTOR RCTIVITV a - 7> - 

curriculum content - primary 
::;•;£ stopped chhnm) - 

,'iLl.OCRTED TIME CMIN'S) - 



1147 
12 

2 a OTHER-PACED 

-99 MISSING DRTR— - 

-99 MISSING DATA— 

-99 MISSING DATA— 

6 - SUPERVISING 

56 = RECREATION*- BREAK 

1225 



i-:t-jf *:u:t:.tc I DENT I F I CRT I ON DRTR *************:******^ 



OS SERVAT I ON DRTE < MMDDW > 
o 'jDSERVER # - 
ERJCrSRCHER # - 

FRRGET STUDENT # - 



4 
1 



309 



8 



CLASS TYPE <1 
CLASS SIZE a 



4) - 
999 > 



» SELF-CONTAINED 



****** EDUCATIONAL flCTIUITV DATA ****** ACTIVITY # 9 

TINE STARTED " < HHMM > -. 1238 
tt STUDENTS IN SAME ACTIVITY - 1 



ALLOCATED TIME WIN'S) - 7 

****** REAL-TIME CODING DATA ****** ACTIVITY # 9 

TIME STARTED REAL-TIME -CODING 1238 
# OF REAL-TIME CODES 8 

1 - EC NU NU 

2 EW NU HU 
~ - NO NU NU 

4 •- EUI NU NU 

5 - ED 3D TS 

6 - EW NU NU 

7 - EW NU NU 
0 - El; NU NU 

*** REAL-TIME CATEGORY SUMMARY *** 



TS PACING - 

TS ACTIVITY a - 7> - 

TS ACTIVITY -2ND -. 

TS TASK DIFFICULTY <1 - 3> - 

TS INSTRUCTOR <1 - 6) - 

INSTRUCTOR ACTIVITY <i -7) - 

CURRICULUM CONTENT - PRIMARY 

TIME STOPPED <HHMM> - 




» SELF-PACED • 
= WRITING 
- SILENT READING 
= EASY 

* NO INSTRUCTOR 
■ SUPERVISING 
* DECODING/PHONICS 



•'FOR THIS ACTIVITY) 



FREQUENCY 



PERCENT 



EW 
EO 





BEST COPY AVAILABLE 



BEST COPy AVAILABLE 



******* I PENT I F I CAT I ON DATA *********************************** 

OBSERVATION DATE <MMDDW> ~ 31281 
OBSERVER # - 4 
TEACHER # - 11 
TARGET STUDENT # - 1 

CLASS TVPE a - 4> - 3 ■ SELF-CONTAINED 

CLASS SIZE <1 - 99.9 > - 12 

****** EDUCATIONAL ACTIVITY DATA ****** ACTIVITY # 10 



TINE STARTED <HHMM> - 


12 


39 




# STUDENTS IN SAME ACTIVITY - 


1 






TS PACING - 


1 




SELF-PACED 


TS ACTIVITY <1 - 7> - 






SILENT READING 


TS ACTIVITY -2ND - 


6 




WRITING 


T3 Tr. ,< DIFFICULTY <1 - 3> - 


1 




EASY 


TS INSTRUCTOR U -'&> - 


6 




NO INSTRUCTOR 


INSTRUCTOR ACTIVITY <1 - 7> ~ 






SUPERVISING 


CURRICULUM CONTENT - PRIMARY - 


13 




■ COMPREHENSION 


TIME STOPPED <HHMM> - 


12 


42 




ALLOCATED TIME <MIN'S> - 









****** REAL-TIME CODING DATA ****** ACTIVITY # 10 

TIME STARTED REAL-TIME CODING 1239 
# OF REAL-TIME CODES 4 

1 EC NU NU 

2 - EO MU NU 

3 - EW NU NU 
'•I - EW NU NU 

*** REAL-TIME CATEGORY SUMMARY *** 

<FOR THIS ACTIVITY) 

FREQUENCY PERCENT 



EW 


Jm 


5 ft 


EG 


1 




EC 


1 

0 


0 


ED 
NI 


0 
0 


0 
0 


i !W 
rid 


0 


0 


NU 


4 


166 


r.M 


0 


0 


iiF 


0 


o 


>"vj. 


0 


s 


:;;i 


0 


0 




0 


0 


SD 


0 


0 


TF 

V 


0 


0 




4 


100 



311 



c 

e 



10 



TS 
GR 



0 

0 



0 



******* I DENT I F I CAT I ON DRTfl *********************************** 

1281 



OBSERVATION DATE <MMDDVV> - 
OBSERVER tt - 
TERCHER * - 
TARGET STUDENT # - 
CLASS TVPE U - 4> - 
CLASS SIZE a - 999) - 



4 

11 

1 

3 = SELF-CONTAINED 
12 



****** EDUCATIONAL ACTIVITY DATA ****** ACT I VI TV # 11 



TIME STRRTED <HHMM> - 

# STUDENTS IN SAME ACTIVITY - 

TS PACING - 

TS ACTIVITY <I - 7) - 

TS ACTIVITY -2ND - 

TS TASK DIFFICULTY <1 - Z) - 

TS INSTRUCTOR <1 - 6> - 

INSTRUCTOR ACTIVITY CI - 7) - 

CURRICULUM CONTENT - PRIMARY - 

TIME STOPPED (HHMM) - 

ALLOCATED TIME WIN'S) - 



1243 
1 

1 - SELF-PACED 
1 = ORAL READING 
6 = WRITING 
1 = EASY 

6 * NO INSTRUCTOR 
6 = SUPERVISING 
12 - WORD MEANING 
1247 
4 



****** REAL-TIME CODING DATA ****** ACTIVITY # 11 

TIME STRRTED REAL-TIME CODING 1243 
# OF REAL-TIME CODES 5 

1 - EC NU NU 

2 - EW NU NU 

3 - EW NU NU 

4 - EW NU NU 

5 -• EW NU NU 

*** REAL-TIME CATEGORY SUMMARY *** 
<FOR THIS ACTIVITY!.' 

PERCENT 



5EQUENCV 



EW 



■ I \ 



. « T 
I 1 .1 

' ;!;! 
r :: J 



hF 

ER1C .H 



4 
0 
1 

0 

0 
0 

3 

0 
@ 

Q 

0 
0 



8b 

0 
0 

c 



10g 
0 

0 
0 

0 

0 



BEST COPY AVAILABLE 



312 



11 



SO 0 0 

TF © ✓ 0 

NU 5 108 

TS 0 0 

GR 0 0 



******* I DENT I F I CAT I ON DATA *********************************** 

OBSERUATION DATE <MMDDW> - 31281 

OBSERUER # - 4 

TEACHER # ~ 11 

TARGET STUDENT # - 1 

CLASS TVPE <* - 4> - 3 - SELF-CONTAINED 

CLASS SIZE <1 - 999) - t2 



****** EDUCATIONAL ACTIUITV DATA ****** ACTIUITV # 12 

TIME STARTED <HHMM) - 1247 

# STUDENTS IN SAME ACTIUITV 1 

T5 PACING - 1 « SELF-PACED ' 

TS ACTIUITV <1 - 7> - 6 = WRITING 

TS ACTIUITV -2ND - 2 « SILENT READING 

TS TASK. DIFFICULT 1 ,-' <1 - 3> - 1 = EASV 

TS INSTRUCTOR <1 - 6) - 6 = NO INSTRUCTOR 

I! "~~RUCTOR ACTIUITV <1 - ?') - 6 - SUPERUISING 

CU. . ilCULUM CONTENT - PRIMARV - 18 = READING RELATED-OTHER 

TIME STOPPED <HHMM) ~ 1252 

ALLOCATED TIME <MIN'S> - 5 

******* REAL-TIME CODING DATA ****** ACTIUITV # 12 

TIME STARTED REAL-TIME CODING 1246 
ft Or REAL-TIME CODES 6 

1 - EC NU NU 

2 - EUI NU NU 

3 EW NU NU 

4 - EW NU NU 

5 - EW NU NU 

6 ■■■■ EW NU NU 



iUENCV PERCENT 



'3:1 



ill 



s 


"y ***** ***** ***** 


0 

I 


lb. bbbf 


0 • 


0 


0 


0 


0 
0 


0 

d 


6 


100 



BEsST nOPY AVAILABLE 



c 
c 



*** REAL-TIME CATEGORV SUNKARV C 
<FOR THIS ACTIUITV) 



C 

e 



NI.J 0 0 ^ ' 

O ;.;0 

ERJC Q 1 o 

^ HII £ 100 ^. 



I 11 1 




0 


RF 
AQ 


0 
0 


6 


'..'I ! 

.-.N 




0 
0 


.\r 


0 


0 




0 


0 


TF 


0 


0 


NU 


6 


10© 


TS 


0 


0 


GR , 


0 


0 



BtST COPY AVAILABLE 



******* I DENT I F I CAT I ON DflTR *********************************** 

OBSERVATION DATE <MMDDVV> - 31281 

<. OBSERVER tt - 4 

TEACHER # - 11 

TRRGET STUDENT # - 1 

CLRSS TVPE <1 - 4> - 3 . = SELF-CONTAINED 

=ISS SIZE a - 999 > - 12 



****** EDUCATIONAL OCT I UI TV DATA ****** ACTIUITV # 13 

TIME STARTED <HHMM> - 1234 

# STUDENTS IN SAME ACTIUITV - -99 MISSING DATA 

TS PACING -99 MISSING DRTR 

TS ACTIUITV <1 - 7) - 2 = SILENT READING 

TS" ACTIUITV -2ND - 6 ~ WRITING 

TS TASK DIFFICULTV <1 - 3> - . 1 = EPlSV 

TS INSTRUCTOR <1 - 6> - 6 ~ NO INSTRUCTOR 

INSTRUCTOR ACTIUITV <1 - 7) - 6 » SUPERVISING 

CURRICULUM CONTENT - PRIMARY - 25 * DIVISION 

TINE STOPPED <HHMM> - 1300 

ALLOCATED TIME (MIN'S) - b 

****** REAL-TIME CODING DATA ****** ACTIUITV # 13 

TIME STARTED REAL-TIME CODING 1254 

# OF REAL-TIME CODES 5 

1 - EC NU NU 

2 - EW NU NU 

3 - EW NU NU 

4 - EW NU NU 

5 - EW NU NU 

■w.,: REAL-TIME CATEGORV SUNMARV *** 
-■FOR THIS ACTIVITSv 
FREQUENCE PERCENT 



EO 


4 * 

0 


0 




l 


*L 


ERjcfp 


o 


0 




0 ' ' 


0 



314 



13 



NW • 


0 ■> 


0 


NO 


0 


0 


MU 


RS! 

'J 




rin 






RF 

flQ 


0 


0 




0 

A 
U 


0 

U 


VP 


iTi 


0 


CT'i 


O 




TF 


0 


0 


MU 


5 


100 


TS 


0 


0 


GR 


0 


0 



BEST COPY AVAILABLE 



******* I DENT I F I CRT I ON DfiTfl *********************************** 



OBSERVATION DATE <MMDDW> - 
OBSERVER # 
TEACHER # - 
TARGET STUDENT tt - 
CLASS TVF'E <1 - 4> - 
t~4~.c, SIZE '•! 1 — 999 > — 



31281 
4 
11 
1 

3 * SELF-CONTAINED 
12 



****** EDUCATIONAL ACTIVITV DATA ****** ACT I VI TV # 14 



TINE STARTED (HHMM) - 

tt STUDENTS IN SRI- IE ACTIVITY - 

'PRCIf«S"-"- 
TS ACTIVITV <i - 7> - 
TS ACTIVITV -2ND - 
TS ACTIVITV -3RD - 
TS TASK DIFFICULTY <1 - 3> - 
TS INSTRUCTOR O - 6> - 
INSTRUCTOR ACTIVITV <1 ~ ?> - 
INSTRUCTOR ACTIVITV -2ND - 
CURRICULUM CONTENT - PRIMARY - 
CURRICULUM CONTENT - SECONDARY 
TIME STOPPED (HHMM) - 
ALLOCATED TIME <MXN'S> - 



1305 
6 

2 - OTHER-PACED 

4 * LISTENING 
6 « WRITING 

1 ■ ORAL READING 

3 « HARD 
3 ■ AIDE 

5 * TESTING 

6 « SUPERVISING 

4© = PHVSICAL--BIOLOGICRL SCIENCES 

12 = WORD MEANING 

1316 

11 



: ****** REAL-TIME CODING DATA ****** ACTIVITY 1* :L"4 

TIME STARTED REAL-TIME CODING 1305 
it OF RERL-TIME CODES 12 

1 - ED SD GR 

2 • - EO AF GR 
w - EO AF GR 
4 - ED SD GR 

3 - EW AG GR 
6 - EW AQ GR 
? - NI AQ GR 
0 - £UI AQ GR 
9 - EW AQ GR 



ERIC i© .... Ei.,,1 flQ GR 
11 - EW AQ 
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12 - HI RQ GR 



i 
t 
1 



*** REAL-TIME CATEGORY SUMMARY *** 
(FOR THIS ACTIVITY) 
FREQUENCY PERCENT 



EU 


ft 


WW 


ED 


•■Ji 


j ,« ,« ,«• .« — ^ 

lb. bbb t*' 


EC 


0 


0 


FD 




Abu bbb i 


MI 




lb* bbb r 


NW 


0 


0 


NQ 






NU 


0 


0 


AM 


0 


0 


AF 


•iSn 


16.6667 


AQ 


O 


b6« fc>66r 


)<H 


0 


0 


XP 


0 


0 


SD 




16. 666'7 


TF 


0 


0 


NU 


0 


0 


TS 


0 


0 


GR 


1 ~» 

•It .Im» 


10© 


if.:*:**:*:*:* 


IDENTIFICATION DATA > 


OBSERVATION DATE 


CMMDDYV) - 


OBSERVER 


tt - 




TEACHER ff 






TARGET STUDENT ft 




CLASS TVP 


e a - 4 


Y> - 


CLASS SIZ 


E CI - ': 


<99 > - 



BEST COPY AVAILABLE 



312S1 
4 
11 
1 

3 ~ SELF-CONTAINED 
12 



*•*.**•** EDUCAT I ONAL 


ACTIVITY 


DATA *****:• 


h ACTIVITY # 1 


TIME STARTED <HHMM> 




1319 




¥: STUDENTS IN SAME 


ACTIVITY 


1 




TS PACING -• 




1 * 


SELF-PACED 


TS ACTIVITY <i - 7> 




6 s 


WRITING 


TS ACTIVITY -2ND 






SILENT READING 


TS TASK DIFFICULTY 


<1 - Z> - 




MEDIUM 


TS INSTRUCTOR <1 - 




6 = 


NO INSTRUCTOR 


INSTRUCTOR ACTIVITY 






SUPERVISING 


CURRICULUM CONTENT 


- PRIMARY 




" DIVISION 


TINE STOPPED <HHMM> 




J «M *•»» ►♦►♦» 

I w« •«.> r' 




.'LLOCATED TIME <MIH 




IS 





■.^■.m* REAL-TIME CODING DATA ****** ACTIVITY ft 15 
O TIME STARTED REAL-T I MECOD I NG 131':.' 

EMC :; of real-time codes *% 3|g 



15 



1 

i 


— CTI.I 


NU 


Ml 1 

NU 




— bw 


NU 


Ml 1 

NU 




— M i 


NU 


Ml 1 
NU 


.1 
M 


"~ NU 


1 r 


UK 


rr 

3 


~* NU 


l r 


uK 


M 

£» 


kin 


1 r 


UK 


i* 


— Mfl 

— rsu 


1 r 




o 
o 


•~ NU 


TET 

1 r 


UK 




~" NU 


I r 


ur> 


1 u 




Ml I 
NU 


Ml 1 
NU 


1 I 


Chi 


NU 


Ml 1 
NU 


X 4m 




Ml 1 
NU 


Ml 1 

NU 


1 T 


— etu 


Ml 1 
NU 


Ml 1 
NU 


1 

i*i 


mm CM 


Ml 1 
NU 


Ml J 
NU 


1 er 
IJ 


— EW 


Ml 1 

NU 


Ml f 
NU 


16 


- EW 


NU 


NU 


17 


- EW 


NU 


NU 


I'd 


_ EW 


NU 


NU 


19 


- EW 


NU 


NU 


28 


- ED 


SD 


GR 



*** REAL-TIME CflTEGORV SUMMARY *** 
CFQR THIS ACTIVITY) 
FREQUENCY PERCENT 



EW 12 6Q 

EG 0 © 

EC 0 0 

ED 1 5 

lu 1 5 . 

HUi O 0 

NO 6 30 

NU 13 65 

AN 0 0 

"•if 0 0 

, r iQ 0 0 

. i:H 0 0 . 

;;p 0 0 

SO 1 5 

TP 6 siW 

MU 13 • 65 

T 1 "; 0 0 

-*£T. —» "pes* 

i.jR r 

m-*:k:k*m<* I DENT I F I CRT I ON DfiTR ********»*****^^ 

OBSERVATION DATE "CMNDDS'V) - 31281 
OBSERVER ;r - 4 
TEACHER tt ~ H 
TARGET STUDENT tt - 1 

CLASS T7PE <1 - 4> - 3 « SELF-CONTAINED 

®~CL;iii SIZE <1 - 999) - 12 
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****** EDUCATIONAL RCTIUITV DATA ****** ACTIUITV # 16 

TIME STARTED <HHMM> - 1337 

3 STUDENTS IN SANE ACTIUITV - 12 

TS PACING ~ 2 * OTHER-PACED 

TS ACTIUITV <1 - 7> - -99 MISSING DATA — 

TS TASK DIFFICULTY <1 - 3> - -99 MISSING DATA 

TS INSTRUCTOR <1 - S> - -99 MISSING DATA — 

INSTRUCTOR ACTIUITV U - ?'> - 6 = SUPERUISING 

CURRICULUM CONTENT - PR I MAR V - 56 - RECREAT I OUTBREAK 

TIME STOPPED <CHHMM> - 1408 

ALLOCATED TIME CMIN'S> - 23 

*** REAL-TIME CATEGORY SUMMARY *** 

<FOR ALL ACTIUITIES> - 





FREQUENCY 


PERCENT 


EUI 


53 


46.7692 


EO 


32 


24.6154 


EC 


11 


S. 46154 


ED 


15 


1 1 . 5385 


NI 


5 


3.84615 


NW 




2.38769 


NO 


ii 


8.46154 


NU 


66 


58.7692 


AM 


6 


4.61538 


AF 


21 


16. 1333 


RQ 


IS 


13.3462 


XN 


0 


0 


XP 


0 


6 


SD 


13 


10 


TF 


6 


4.61533 


NU 


66 


30.7692 


TS 


25 


19.2363 


GR 


39 


30 • 
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INTRODUCTION 

Recently, a substantial number of educational studies have sought to identi- 
fy activities which significantly impact on student achievement. The results of 
these studies have 'produced virtual universal agreement that Academic Learning 
Time (ALT) is one of the most significant determinants of student achievement. 
ALT refers generally to the time 'students spend actively engaged in academic 
tasks which they complete with high success. It contains three components that 
have been found to be highly related to student achievement: 1) Amount of time 
allocated to instruction, 2) Amount of time that students are actually engaged 
in academic activities, and 3) Amount of time that students are engaged in 
academic activities completed with high success. 

Allocated time . The amount of time allocated by a school district and/or a 
teacher for instruction has been found to be an important predictor of student 
achievement. Some studies have demonstrated that the length of the school day 
and t ; ie length of the school calendar influence student achievement. Othe^ 
studies have found that the more time that a teacher allocates to a subject 
matter area, the greater the level of student achievement. Further studies have 
systematically examined the amount of time that is actually allocated for in- 
struction in typical classrooms. The results indicated that in selected second 
grade classrooms 57* of the school day was allocated to academic activities, 
whh 24* devoted to non-academic subjects such as music, art, affective and 
physical education, and the remaining 19% was spent in transitional activities. 
Fifth grade pupils had 6Q%joi their time allocated to academic activities, 23% 
to non-academic activities, and 17% to transitional activities. This information 
suggests that room exists for increasing the amount of time that is allocated for 
instruction. Wo also know that, should this occur, it is likelv that student 
achievement will increase. 
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Engagement time. The second component of ALT is the proportion of allo- 
cated time that students are actively engaged in academic tasks.' Student en- 
gagement time was found to be even more highly related to student achievement 
than allocated time. These results suggest that students who pay attention to 
and work more on academic tasks are also those who learn more. Studies that 
have examined the amount of time that students are engaged during the .school 
day have reported results ranging from 40 to 80%. Information reported by most 
authorities suggests that at least 80% engagement is optimum for most students. 

Success tim e. The final component of ALT is student success rate on aca- 
demic tasks. Studies have clearly indicated that the^more time that students 
spend on tasks which they complete with high success, the greater their level of 
achievement. These studies reveal that pupils who spend more than half of their 
time on high success tasks (i.e., tasks on which students attain accuracy scores 
of 80% or higher) also attain higher achievement test scores, maintain their 
knowledge longer, and have more positive attitudes toward learning. Such re- 
sults suggest that learning basic skills in the elementary grades requires stu- 
dents to experience success on assigned tasks and to thoroughly master skills. 

. Academic success and skill mastery depend very heavily upon accurate in- 
structional programming. Studies haVe demonstrated that high student achieve- 
ment is related co teacher ability to accurately assess students' academic skills 
and to provide appropriate and adequate instructional activities. A though, on 
the surface, this observation represents nothing new-practicioners have forever 
diagnosed students' needs and prescribed instruction-successful results depend 
on the manner in which the assessment, programming and instruction are con- 
ducted. The most compelling evidence indicates that, to maximize a student's 
success on a. particular academic task, a teacher should first assess a student's 
ability to perform the task, provide materials or procedures to directly teach it, 
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^ and then regularly monitor student progres^ on the task. Such systems provide 
feedback to students regarding their performance, as well aTto the teacher 
concerning the effectiveness of the instructional programs. 

Question; Given ie above information, what can you as a teacher specifi- 
cally do to increase the academic achievement of the students in your class- 
room? Answer: Read the subsequent sections of this manual for specific sugges- 
tions on how to increase student academic achievement. i 



9 

ERIC 



323 



- tt - 



TEACHING STRATEGIES THAT INCREASE 
STUDENT ACADEMIC ACHIEVEMENT 



What can you, the teacher, do to increase student academic achievement in 
your classroom? Studies conducted in thousands of classrooms in the U.S. have 
identified a number of specific things that more effective teachers do that are 
associated with greater academic achievement: 

-"Spend more- time on academic subjects, 

- Evoke more student attention to academic tasks, 

- Provide more direct academic instruction, 

- Provide more academic activities in which students experience high task 
success. ° 

In many ways these four areas overlap and are finer related. But the mes- 
sage is clear from the educational studies over the last decade: wiat is not 
taught and attended to in academic areas is not learned. Teachers who are task 
oriented and determined that their students learn are more effective. 

We now want to discuss in concrete terms what it is that these effective 
teachers do. Hopefully, none of these recommendations will surprise you. As you 
read, think about your classroom and students. Ask yourself, "How many of 
these things do 1 frequently do in my classroom? What could I do cliffer#ntiy"> 
that would increase my teaching effectiveness?" 
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S PEND MORE TIME ON APADEM1C SUR.IFrTS 

Your immediate response may be, "But my daily schedule is already full. 
How can I allocate more time for academic subjects?". Before we try to answer 
this question, consider this. Studies show that the more time spent and .he ,nore 
content covered in a subject matter area, the. more students achieve in that 
content area. This should not be surprising. But what js surprising is ,he 
.tremendous vana!^ in the amount of time that teachers allocate to various 
content areas, .r, some elementary classrooms, for example, student, wore ob- 
served to spend an average of Jess ^han one minuje per da* in reading instruc- 
tion, compared to other classrooms where students spent an average of more 
ihjm^^aj^hpursoerdai. Sounds incredible, but that's what was ob- 
served. Of course, these are extreme cases. 

One strategy for allocating more time to academics is for a teacher ,o look 
at the difference between scheduled time and allocated time. For example, a 
teacher may schedule math from 11:00 a.m. to IbM a.m. each day <»0 minutes 
per day). However, by the time the kids arrive from their physical education 
class and get settled, the math activity doesn't really get started until about 
11:10. Subtract 10 minutes. During the lesson, several students become disrup- 
tive and start pencil jabbing. The teacher stops them and interrupts the class to 
give a short lecture on the dangers of pencil jabbing. Subtract 5 more minutes. 
Then, by about 11:30 most of the -tudents have finished the math assignment. 
The teacher tells them, "Since it's so close fo lunch time, you have 10 minufes 
of freie time." Subtract 10 more minutes. 

In this example, which is probably not atypical, forty minutes were sched- 
uled for math, but only 15 minutes were actually spent in math instruction. This 
example also illustrates three causes of decreased instruction time: 
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1) Time spent in transition between activities, 

2) Time spent disciplining or managing student misbehavior, 

3) Time students spend waiting during a scheduled activity. 

Without changing your schedule, you can increase time spent in academic 
content areas by decreasing total transition time, student misbehavior and- stu- 
dent wait time. You can also increase time spent in specific academic content 
areas by scheduling more time for those subjects. 

1. Transition time . In our studies we found that students spent an average 
of about 45 minutes per day in total transition time. This is the time that ac- 
cumulates during the school day between the end of one activity and the beginn- 
ing of the next activity. In some classrooms there was as little as 25 minutes of 

« 

transition time on a given day, and in others as much as 90 minutes. Of course, 
some transition time is inevitable. 



PROJECT ONE: Here's a little project for you to do: Make a copy of your 
weekly schedule of activities, including lunch, recess, collecting lunch money, 
taking attendance, etc., as well as the usual subject areas such as read.ng, spel- 
ling, math, science, social studies, art, music, and P.E. For one week, write 
down on your schedule the exact clock times that' each activity actually begins 
and ends. An activity begins when your students actually start dealing with the 
directions or substance of the'learning activity. Likewise, an activity ends when 
your students actually stop dealing with the content of the learning activity. 
Keep a record of these activity start and stop times for a week. At the end of 
the week, add up the time intervals between activities (i.e., transition time). 
.Divide by five to get the average amount of transition time per day. 
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If you're like most teachers when you complete PROJECT ONE, you may be 
surprised at how quickly transition time accumulates. Think of it 'this way: If 
' you can decrease transition time by 15 minutes per day, then over the course of 
a 180-day school year, you will have »5 more hours to spend on instruction . 

How can you reduce transition time? There are many ways. Here are two: 

• Make sure that all necessary lesson materials and supplies are assembled 
beforehand and are near at hand for both you and your students. 

Start an activity promptly. Don't wait for stragglers. At first some "foot 
draggers" may miss out on the beginning of a lesson, but they'll soon get 
the message that you mean business. 

Some teachers feel that transitions between activities provide respite for 
students— i.e., "break time". We agree that some break time is necessary, since 
it is unrealistic for students to concentrate continuously all day long. In ele- 
mentary schools, morning and afternoor> recesses and lunch help fulfill the need 
for break time. However, when the transition time between school and classroom 
activities which accumulates during the day becomes greater than the time 
spent on an important academic subject area, a teacher should evaluate ways of 
reducing transition time and increasing instructional time. 

2. Time spent disciplining . Obviously, the more student off-task behavior 
there is, and the mpre time you need to spend disciplining or managing it, the 
less time there is available for instruction and learning. There are hundreds of 
methods of dealing with misbehavior, but research has not shown any method to 
be always superior to all others. In a famous study by Jacob Kounin, he discov- 
ered that the specific type of classroom behavior management technique was 
not nearly as important as its correct targeting and timing. He coined a term, 
"withitness", to describe teacher disciplining which has correct targeting and 
timing. Withitness promotes high student task involvement and minimal misbeha- 
vior. Teachers who are "withit" continually monitor their classrooms for potenti- 
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al behavior problems, and they communicate to their students that they know 
what's going on. If there is a misbehavior, a "withit" teacher correctly identi- 
fies misbehaving students (correct targeting) and deals with it immediately 
(correct timing). ' 

Teachers ,who make target errors may discipline the "wrong" student (one 
who is innocent, an onlooker, or an imitator), or deal with a less serious misbe- 
havior when a more serious misbehavior is occurring, A timing erro r occurs 
when the misbehavior "spreads" to other students or increases in seriousness 
before the teacher does something about it. 

Thus, one effective way to minimize student misbehavior is to be "withit" in 
classroom behavior management. When less student misbehavior occurs, more 
time can be spent on the content of the lesson. 

Another method, which has successfully increased the amount of appropriate 
student behavior, and diminished inappropriate behavior, is to praise students 
periodically for paying attention and for behaving appropriately. For example, a 
teacher might periodically look around the classroom while conducting a reading 
group to identify and verbally praise students who are behaving appropriately. 
This practice has two distinct advantages. First, it p'jvides teacher attention 
to students who are behaving appropriately, thus reinforcing that behavior, and 
secondly, those students are presented as socially -acceptable models for other 
members of the class to emulate. 

3. Time students spend waiting. In our study students we're observed to. 
spend an average total of about 19 minutes per day waiting during activities. ' 
Thi< means fha ey were either finished with their work early, or they.could 
not continue working because they were waiting on the teacher or someone else 
in order to continue. Over the course of a ISO-day school year, that aods up to 
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approximately 55 hours spent waiting, Note that wait time does not include time 
spent in transition between activities. 

Of course, some student waiting is inevitable. For example, if a student is 
stiick on an assignment and needs help, it may be serveral minutes before you 
can get free to help that student. On the other hand, when some students finish 
an assignment early, you can simply prepare in advance similar additional work 
for' those faster working students. You could have a folder or file of "bonus" 
assignments or "challengers" that students know they can do if they finish the 
original assignment early. If possible, these extra tasks should be clearly related 
to the objectives of the original assignment. 

Another common example of student wait time occurs when elementary stu- 
dents stand in line at the teacher's desk waiting to get their papers graded. A 
couple of ways you can decrease this kind of wait time is to: 1) Provide answer 
sheets so that students can correct their own papers after they are finished. 2) 
Correct papers afterwards as a group activity (and you can spot check answer 
sheets occasionally). Students can exchange papers if you're concerned about 
cheating. Needless to say, these strategies will not be suitable for some assign- 
ments, but you can decrease wait time using these strategies on assignments 
which are suitable. 

Scheduling . You should not overlook the possibility of scheduling more 
time for certain kinds of academic activites. Of course, there will be trade-offs 
in time scheduled for other activities, since the total amount of time per day is 
fixed by school hours. For example, scheduling 10 more minutes per day for 
reading instruction adds up to 30 extra hours of time allocated to reading over 
the course of a school year. You might think that, when allocated tunc is in- 
creased, student attention will tend to decrease. Studies have shown, however, 
that this does not generally happen. When time allocated to a particular content 
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area is increased, ' total student engagement time in that content area also 
increases. 

Another way to beef up your schedule is to include, for example, more 
reading, writing, and math related activities in other subject areas, such as 
science and social studies. Students can get practice in the basic skills while 
they are learning other content as well. 

Summary. You can increase the amount of time spent in instruction on 
academic content areas by: 

- Reducing transition time between activities, 

- Decreasing student misbehavior and time spent disciplining, 

- Decreasing student wait time during activities, 

- Increasing time scheduled for those, content areas. 
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EVOKE MORE STUDENT ATTENTION TO ACADEMIC TASKS 

Even thQugh you have maximized allocated instructional time, some students 
may have relatively low task engagement rates. For example, Jimmy may pay 
attention about 60* of the time, whereas Sally is usually on- task 80* of the 
time. These task engagement rates are not uncommon. On the average," most 
students pay attention to academic learning activities between 70 and 75% of 
the time. 

Studies have shown that increased student engagement time in academic 
content areas is associated with greater' achievement in those areas. Again, it 
doesn't take long for small differences in daily engagement time to add up. For 

c 

example, suppose you have scheduled and spend 90 minutes in reading instruc- 
tion per day. If a student is engaged 70% of the time, his/her engagement time 
in reading is 70% X 90 minutes, or 63 minutes per day on the average. If that 
same student were to increase his/her engagement rate to 80%, then total en- 
gagement .time would be 72 minutes per day. You may say, "Nine more minutes 
of student engagement per day doesn't sound like much." But consider that this 
is equivalent to 27 more hours of student engagement time in reading over the 
cour^ of a school year. Looking at it another way, at a 70% engagement rate, 
about 5 extra weeks of school would be required to equal the total amount of 
engagement time a child would accrue at an 80% engagement rate during the 
normal school year. 

What can you do to increase student attention? Of course, some factors are 
often beyond your direct control, such as student motivation to learn, student 
fatigue (due to not enough slt-cp, poor diet or health, low blood sugar), the hu- 
midity and temperature in the classroom, etc. Tbere are other things you can 
control, however: 
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- Praising students for appropriate behavior, 

- Being "withit", 

- Doing more groupwork and providing more direct instruction, 

- Providing a variety of learning tasks, , 

- Supervising seatwork activities more closely. 

Praising students ior aDDropriate behavior .- Man v st) have demomtrared- 



that teacher praise provided to students who are working diligently on their 
assignments served to increase student engagement. This technique was found to 
work even more effectively when it was combined with ignoring off-task be- 
havior. Later studies found that the positive effects of this technique also 
spilled over to studen treated adjacent to the target students. Unfortunately, 
this technique is frequently overlooked because of its simplicity. But the point 
remains that it has been found to be one of the most effective techniques for 
increasing student engagment. In addition, many other studies have been con- 
ducted that demonstrate that point systems are very effective devices for in- 
creasing student engagement. 

Being- "withit". As discussed above, teachers who are more "withit" have 
classrooms whose students are on-task a greater proportion of the time and mis- 
behave less often. Being "withit" means that you have "eyes in the back of your 
head" and communicate to your students that you are aware of what each stu- 
dent is doing. A "withit" teacher deals with off-task student behavior with cor- 
rect targeting and timing. A positive form of "withitness" is to be aware of stu- 
dents who are actively engaged with the task, and praiie those students. Studies 
have shown that teachers have been able to successfully increase student task 
engagement rates by regularly scanning their classrooms (e.g., once every five 
minutes), identifying those students who are on-task, and then providing some 
kind of reinforcement to those students. 
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Doing more groupwork . Studies have shown that students generally pay more 
attention during teacher-led group activities, compared to independent seatwork 
activities. We believe that the major reason for this increased student engage- 
ment is that more direct instruction is usually provided during teacher-led group 
activities. In our study we found that any given student was on-task an average 
of 95% of the t ime- when- direct-instruction Ava6-being-pt^kfeth=e^her-sp^-c 
ally to that student, to another student in the group, or to the group as a 
whole. On the other hand, when no direct instruction was being provided to the 
student or group including the student, s/he was engaged about 58% of the time 
on the average. Another way of -looking at this, students were 8 times more 
jikejy to be off-task when no direct instruction was being provided , compared 
_to _their off-task behavior when there was direct instruction . Direct instruction 
includes teacher feedback, questioning, explaining, and structuring/directing. 
More will be said about direct instruction in a later section. 

Studies have indicated that 30 to W% 0 f the' time is typically devoted to 
teacher-led group activities at the elementary level, and about 60 to 70* of the 
time is spent in independent seatwork activities. Thus, one way to increase stu- 
dent attention is to schedule more group activities and therefore less indepen- 
dent seatwork. If you do more group activities, you will automatically increase 
the amount of direct instruction that you provide. This will result in increased 
student attention and, in the long run, greater gains in academic achievement. 

A concrete way to go about increasing the number of group activities is to 
consider one activity per day that you have scheduled for seatwork (e.g., a lan- 
guage arts or math worksheet). Then, think of a practical way to convert that 
seatwork (-outwit into a group activity. Rv doing just one more group activity 
per day (and one loss seatwork activity), we have estimated that total engage- 
ment time per student would increase by about 21 hours over the course of a 
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school year— that's just for one more 20-minute teacher-led group activity per 
day. 

Several ravcats tin- in order hero: First, increasing j^roupwork does not im- 
ply that seatwork should be excluded. Students obviously do need time to work 
by themselves at their own pace during certain stages of learning. Second, stu- 
dent s kill levels must be taken into account i n group work. If t hp s±udeitfs_in the 
group are too divergent in their skill levels, doing an activity in one large group 
may be counterproductive, and it may be best to group students, according to 
ability and .instruct them in a group, while students who could not profit from 
this type of instruction are assigned seatwork. Third, it is worthwhile to consid- 
er the reasons why students are off-task more often during seatwork. Part of 
their inattention can be attributed to the nature of teacher supervision of seat- 
work. (More will be said about this in a later section.) A more important reason 
may be that the tasks required during seatwork may not be very interesting to 
students , or instructions are unclear. Much seatwork at the elementary level 
consists of worksheet or workbook activities. In effect, this format requires 
that students do a great deal of "pencil pushing'^ It may be worthwhile to con- 
sider other kinds of independent seatwork formats besides worksheets. 

Providing a variety of l earning tasks . More variety of activities during a 
lesson is associated with higher student engagement rates and achievement 
gains, according to the results of classroom observational research. If there is 
little variety in classroom learning tasks, student, will find ways to introduce 
variety themselves-of ten this will be in the form of off-task behavior. The old 
adage, "variety is the spice of life," applies to learning as well. In light of the 
above discussion, one simple way to introduce variety is by alternating group'" 
and seatwork activities. In our study we observed a teacher who did not do this. 
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She typically scheduled entire mornings with mostly seatwork activities and the 
afternoons were devoted primarily to groupwork. Predictably, we observed a lot 
of off-task behavior in the mornings. By simply alternating seatwork and group- 
work throughout the day, this teacher could have substantially increased student 
engagement time. 

Further Muiey studies have shown that student engagements higher during a 
seatwork activity which immediately follows a group activity, than it is during a 

t 

• seatwork activity which follows a previous seatwork activity. 

Other ways to increase variety can be achieved after careful consideration 
of the types of tasks that students are expected to perform-i.e., the content of 
the tasks and the kinds of responses students are required to make. Think about 
varying from task to task the sensory modalities used (i.e., seeing, hearing, 
smelling, touching, tasting) and the kinesthetic requirements. 

Supervising seatwork activites more closely . Studies have shown that stu- 
dent attention is higher during seatwork when there is more active supervision. 
Active supervision means that the teacher circulates among the class, monitor- 
ing the progress of student work, occasionally providing encouragement and spe- 
cific feedback to students, and providing assistance to students when needed. 

If you are working with another group at the time, you can position yourself 
so that you can keep an eye on the students in seatwork. Kounin identified a 
teacher behavior that he termed, "overlapping", which refers to teacher mani- 
festation of attention to more than one student or activity at the same time. 
For example,. suppose you are working with a small reading group and you notice 
that Cindy (in seatwork) has just gone off-task. Without interrupting your small 
group, you look up and quickly praise Cindy's neighbor Vlary for paying atten- 
tion. Then if you note that Cindy has returned to task, she could be praised. \t 
the same ti ne, you have not disrupted the flow of your reading group. Or sup- 
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pose that Edward (also in seatwork) comes to you for help while you are con- 
ducting the reading group. You briefly assist Edward, while at the same time 
keeping the reading group going. These are examples of teacher "overlapping". 
Teachers who "overlap" more often have classrooms with higher student task 
involvement. 

""Thus, wtferTffie whore~c7ass~ is~Wng" seat work, you can actively supervise by 
circulating and monitoring. If part of the class is doing seatwork and the re- 
mainder are in a group you are leading, you can actively supervise by "overlap- 
ping". Obviously, you don't want to overdo active supervision to the e<tent that 
it disrupts student attention to task or makes students feel nervous about being 
observed. On the other hand, if students know they're not being closely super- 
vised during seatwork, they are more likely to be off-task. Let them know that 
you are aware of what they're doing and that you're trying to help them learn. 
This will help increase student attention during seatwork. 

Summary. There are at least five things you can do to increase student 
attention: 

- Praising students for appropriate behavior, 

- Being "withit", 41 

- Doing more group and less seatwork activities, 

- Providing a variety of learning tasks, 

- Supervising seatwork activities more closely. 
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PROVIDE MORE DIRECT ACADEMIC INSTRUCTION 

We have defined 'direct academic instruction' as interaction with students 
on the substance or directions of an academic task. Research studies have found 
that more direct instruction in academic content areas is associated mth great- 
er student achievement gains in those academic areas. Teachers who engage » . 
more direct academic instruction tend to lead more group activities, as dis- 
cussed above, although direct academic instruction can also occur in seatwork 
settings with individual students. Direct academic instruction includes: 

- Feedback, 

- Questioning, 

, - Explaining/modeling, ' 

- Structuring/directing, 

Academic feedbac k. Thi. occurs whenever the student is informed* of the 
correctness or incorrectness of his/her response(s) on the substance of an aca- 
demic task. Note that, while the teacher is often the source, feedback to a stu- 
dent can also come from the learning materials themselves, a peer, an aide, or 
an instructional device such as a computer. Research has generally indicated 
that more academic feedback is associated with greater gains in achievement. 

Obviously, feedback is important, for without it, how would students know 
that they have correctly learned? Also important is the timing of feedback. 
Studies have shown that the more immediately feedback is given, the more ra- 
pidly learning occurs. Immediate feedback is particularly crucial when students 
are initially learning to do a completely new task. 

Feedback is basically either positive or negative. Examples of positive feed- 
back are "That's right.", "Yes.", "Good.", "Correct.", "You got them all right!", 
etc. Positive feedback is especially important with low-achieving, disadvan- 
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taged, and mildly handicapped children, as well as students from low socioeco- 
nomic backgrounds (low SES). Examples of negative feedback are "No.", "That's 
not right.", "Wrong.", "Try again.", "You missed three problems on the assign- 
ment.", etc. Negative feedback should be minimized with low-achieving, disad- 
vantaged, mildly handicapped, and low SES students. On the other hand, studies 
seem to indicat^4h*tt--high-achieving~students tend to be more tolerant ofttega- 
tive feedback, and if used judiciously, it can enhance academic achievement. 

A common saying is that we learn from our mistakes. Students need to know 
when they have made errors. Therefore, some negative feedback is necessary. 
However, it is very important that the student does not feel demeaned or criti- 
cized as a person when negative feedback is given. Consider these two con- 
trasting examples of negative feedback: 

"Wrong again. You really oughta try harder. You can't learn if you don't 
try!" 

"Let's do this problem again togther. I'll give you some hints as we work 
through it. O.K.?" 

The first instance connotes blame or criticism of the student, whereas the 
second example indicates a teacher willingness to help the student learn. Again, 
research indicates that teacher criticism is negatively related to student 
achievement. 

There used to be a TV commercial for aspirin that showed an irritated and 
frustrated person with a headache saying, "Please! I'd rather do it myself!" 
Likewise, students need the opportunity to self-correct their errors or mistakes . 
In other words, they often want a chance to try to figure out and correct their 
mistakes themselves. This brings up two points: 1) Telling a student the right or 
correct answer immediately after an incorrect response may not be as effective 
in promoting learning as first giving the student an opportunity to self-correct 
the error. Giving a prompt following an incorrect response may be necessary 
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if the student is having some difficulty. The key point is that we don't want to 
overly frustrate a student, but at the same time we do want to give her/him an 
opportunity to self-correct his/her errors. 2) Overdoing negative feedback can 
result in lowering of student motivation and self-esteem. Thus, if a student is 
making many different kinds of errors on a learning task, the teacher should 
ask, "Is this learning task too hard or too advanced for this particular student's 
skill level?" When there are many studem: errors on a learning task, the best 
strategy may be to show the student the correct answer and how to obtain it, 
and then plan subsequent learning activities which ameliorate those particular 
problems, should they persist. Then, provide positive feedback on correct stu- 
dent responses. t 

Academic questioning . Another type of direct instruction is soliciting stu- 
dent verbal responses during a discussion or recitation activity. Studies have 

y' * 

indicated that students were more attentive when they were not sure who was 
going to be called on next to answer. When teachers addressed students in some 
predetermined manner (e.g., going down the row or around the circle), students 
tended to be less attentive. Thus, asking questions which are group-focused and 
then randomly calling on students helps to maintain student attention during a 
recitation or discussion. 

Classroom studies have shown that, when teachers ask more low-level ques- 
tions >vhich are directly related to academic content, their students tend to 
make greater gains in academic achievement. Low-level questions are usually 
convergent-there is a right answer. They often involve recall of^factual infor- 
mation or sequence of events, giving definitions, making discriminations or ob- 
servations, giving or identifying examples of concepts, explaining simple cause 
and effect, etc. 
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Another good reason for conducting some group discussion or recitation in 
academic subjects is that it provides a change of pace from the worksheet and 
workbook activities frequently done in independent seatwork-- i.e., stjdent re- 
sponse modalities are varied from reading and writing to listening and speaking. 
Also, by listening to students respond you can directly monitor student progress 
and provide immediate feedback. 

Academic explaining/modeling . Another component of direct academic in- 
struction is explaining/modeling, which includes statements dealing with the 
content (e.g.,lecturing) and demonstrations of skills. In our stucly we found that, 
when teachers spent several minutes or more giving a planned explanation or 
demonstration during an activity (usually at the beginning), students were about 
five times less likely to perform poorly on the task than when little or no plan- 
ned explanation was given. Verbal explanations of the substance of a task are 
especially important for mildly handicapped and disadvantaged students whose 
reading comprehension is poor. 

Some studies have demonstrated that student reading accuracy is increased 
when the teacher reads the passage aloud before the students are asked to read 
the passage. Other studies have identified teacher clarity as being postively re- 
lated to academic achievement. Thus, clear explanations or demonstrations 
which deal with academic substance are important. Obviously, to use your time 
efficiently, planned explanations or demonstrations should be given to the whole 
group, rather than repeatedly to individual students. 

Even for certain kinds of independent seatwork activities, some explanation 
or modeling seems to make a difference. At the beginning of the seatwork ac- 
tivity, you can explain and/or demonstrate to the group how to do the first 
problem or two. Then, you can ask the students to try the next one or so, giv- 
ing feedback to the group. Finally, students can do the remainder of the assign- 
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ment on their own. This strategy is more likely to result in greater student task 
success than if you give directions only (e.g., "Turn to page 21 of your math 
book. Answer the first 10 questions. Write your answers on a separate piece of 
paper."). 

In contrast to explanations and demonstrations planned ahead of time, one 
large study found that explanation based on immediate student need was nega- 
tively related to achievement in regular elementary classrooms. That is, giving 
more explanations in response to immediate student difficulties or misunder- 
standings of the task is associated with Jess academic growth. This implies that 
initial explanations were possibly unclear or absent, or that the task was too 
difficult for students to begin with.. If you frequently find yourself repeatedly 
gjving explanations to individual students who are' experiencing difficulties with 
an assignment, this should tell you that something's not right. Perhaps the di- 
rections for the task were unclear, the initial explanation was inadequate, or 
the task is simply too hard in its present form. 

On the other hand, these research results do not imply that you should not 
help students who experience difficulties with a learning task. But the findings 
do suggest that, when explanations based on immediate student needs are mini- 
mized, long-term student achievement tends to be higher. 

Academic structuring/directing . Structuring/directing is similar to academic 
explaining/modeling. Strycj^ing/directing occurs when the goals or objectives 
of a task are discussed, or the procedures to be followed in the task are given, 
whereas academic explanations <3r ■ demonstrations deal with the content of the 
lesson itself. Research has shown that more structuring/directing is associated 
with greater academic achievement. 

Teacher structuring/directing of seatwork activities was found in our study 
to be particularly important for minimising low task success of mildly handi- 
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capped students. Since these students' reading skills are often poor, they are 
more likely to understand how they are to do an assignment if the teacher tells 
them the directions, rather than expecting them to read the directions. 

Also, telling or "reminding students of the purpose of a learning activity 
helps them gain perspective on why they are to do it, other than being required 
by the teacher or curriculum. As an example of structuring, a teacher might 
say, "Learning how to spell words correctly is important so other people will be 
able to read and understand what you write." 

Summary. More direct instruction is associated with greater student* 
achievement gains. Direct instruction includes academic: 
Feedback, 

- Questioning, • 

- Explaining/modeling, . • 

- Structuring/directing. 

Direct instruction of groups is also related to high levels of student atten- 
tion, compared to student attention during independent seatwork. 
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PROVIDE MORE OPPORTUNITIES FOR XTlini fflT HIGH TASK SUCCESS 

One of the more important findings of a recent study was the positive rela- 

• tionship between student high task success on daily academic classroom activi- 
ties and academic" achievement. Student high task success means that s/he com- 

Q pletes a task making very few or no errors (e.g., more than- 80% correct re- 
sponses). The more activities that are completed with high success, the greater 
the achievement gains. The converse is true as well: the more activities in . 

" which students perform very poorly (low 'task success), the less the achievement 
gains. This should not be surprising, since task success on classroom activities is 
simply a daily, task-by-task measure of achievement. So it makes sense that, if 
a student frequently performs- well on classroom academic tasks that are related 
to content that is covered on a'n academic achievement test, we would expect 
Itlm/her to do well on the achievement test. 

This finding is also consonant with the concept of- 'mastery learning'. The 
idea of mastery learning is that a student should get an 'A' on the test of at- ' 
tainment of„an instructional objective before moving on to the.next objective. It 
is true that some students will 'master an instructional objective faster than 
others, but this does not mean that the slower students should be denied the 
opportunity to master the objective as well. • ' % • 

Of course, we don't expect, students to do all learning activities with high 
task success. When they are in the Initial stages of learning a new objective, 
they Will typically make mistake* and perform with medium task success (i.e., / 
make some errors, but not all errors). As appropriate feedback is given, their 
task performance should subsequently improve or. similar tasks until they per- 
form consistently with high task success on tHaMnstructional objective. If some 

* 

students often perform poorly on classroom learning tasks, this should tell the 
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toucher something the tasks may bo too hard lor those students. Another way 
of saying this is that the discrepancy is too great between the skills and knowl- 
edge" required by the task ™d the present skills and knowledge of the students. 
One of the alarming, findings in our study of mildly handicapped students was 
that they were observed to experience low task success in about 10* of the 
activities. That is, they did extremely poorly on about I out of every 10 tasks. 
On the other hand, normal students in another study were observed to experi- 
ence low task success about 3% of the time (I out of 33). 

What can you do to increase high student task success and also decrease 
low task success? Obviously this is a herd ^question to answer; but research 
findings suggest several things teachers do: 

- Becoming more familiar with students' skills and knowledge, 

... - Increasing frequency of classroom testing, 

Increasing^ direct instruction, especially planned explanations, demonstra- 
tions, structuring/directing and academic feedback to the group, 

- Increasing the number of act- ities in which previously learned material is 
reviewed. 

This list is only suggestive, clearly incomplete, and there is a good deal of 
overlap. , 

Becoming more familiar with your students' specific skills and knowledge . 

Research has shown that teachers who know their student's better h«.ve class- 
rooms with greater achievement gains. Teacher awareness of specific student 
skills and knowledge was measured iri one study by having teachers predict 
ahead of time which items on an. achievement test that each student would pass 
or fail before they were given the test. This finding implies that teachers who 
know their students better are also in a better position to select or create in- 
structional materials that are well matched to student knowledge and skill lev- 
els. Thus, their students are likely to more often experience high success on 
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classroom tasks and in the long run make greater gains in academic achieve- 
ment. 

Another source of information regarding specific student skills and knowl- 
edge is daily student worksheets. These worksheets provide up-to-date informa- 
tion concerning the students' understanding of instructional content. By simply 
reviewing patterns of correct and incorrect answers a teacher can obtain valu- 
able information on specific student's strengths and weaknesses. This informa- 
tion, in turn, can be used to develop lessons that students can successfully 
complete. 

Increasing frequency of testing . Studies have found that teachers who test- 
ed thei- students more often had students who experienced less low task success 
and more high task success. Testing students need not take up a lot of time and 
can serve two important functions: 1) It provides feedback to students. on their 
learning progress; and 2) It provides feedback to the teacher on student mastery 
of instructional objectives. You don't need a lot of items on a test to find out 
whether a student has mastered an objective. For example, if you construct a 
test of just 5 items which are representative of the content covered by the 
objective and which are randomly selected , you can be pretty confident that 
students who get * or 5 of the items completely correct have mastered the 
objective. Of course, if you want to be more confident or you want to diagnose 
specific student problems, then you can increase the number of items. However, 
it doesn't take very many items to make a decision about student' mastery, if 
the chances of student correctly guessing are low, and the items are represen- 
tative of and randomly sampled from the content. 

If intervals between tests are too long, then each test takes on more 
"importance" to the students and they may become more anxious about testing. 
On the other hand, if tests are given frequently and regularly, then 'each test" 
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becomes less "important"--i.e., if the students occasionally do not do well on a 
test it is not such a big deal, since they know they have many more opportuni- 
ties to demonstrate mastery. 

It is also obvious that teachers who test their students regularly and fre- 
quently are more likely to be attuned to individual student skills and knowledge. 
As discussed above, this teacher awareness is related to overall student 
achievement. 

Furthermore, the very process of constructing a test (or selecting one from 
the curriculum) makes us consider just what it is that we want our students to 
learn— i.e., what our instructional objectives are. Making up a test lor an in- 
structional objective ahead of time helps a teacher to plan and sequence learn- 
ing activities appropriate for reaching that objective. Worksheet content can be 
used effectively to develop highly appropriate tests of student progress. 

Increasing direct instruction . This topic was covered in an earlier section in 
some detail, but bears repeating here. In our study we found that more direct 
instruction was associated with less student low task success. In particular, stu- 
dents vvere two to three times Jess likely to perform poorly on a rask when 
teachers gave some verbal directions, planned explanation or demonstration and 
academic feedback to the group . If the activity was mostly independent seat- 
work, these three types of direct instruction usually occurred during che begin- 
ning of the lesson and lasted several minutes. 

Increasing review lessons . In a review lesson students practice using skills 
and knowledge related to instructional objectives they have already mastered. 
Since they have mastered the objective and if they have not forgotten, they 
will usually perforin the task with high task success. This is a straightforward 
way of increasing the amount of high task success in your classroom. It appears 
that "over learning" of materials is 'important for long term academic achieve- 
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ment. Obviously, review lessons should not be bunched up, but rather spaced at 
regular intervals over time. With mildly handicapped students, regular review 
seems to be particularly important, since they may be more prone to forgetting 
what they have learned. 

One simple way. to do a review lesson is to. take an old test, and instead of 
considering it as a test, have the students do it as a review activity. Also, if 
you discover that some students have indeed forgotten, then you can plan some 
refresher activities for them. Since it is noi practical to regularly review all 
material previously covered, you will need to decide which instructional objec- 
tives are most important and focus on those in your review, lessons. 

Summary . Students who more frequently experience high task success on 
daily classroom activities make greater gains in long term academic achieve- 
ment. Things teachers can do to increase student high task success include: 

- Becoming more familiar with students' skills and knowledge, 

- Increasing frequency of classroom testing, 

- Increasing direct instruction, especially planned explanations, demonstra- 
tions, structuring/directing and academic feedback to the group, 

- Increasing the number of activities in which previously learned material is 
reviewed. 
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SUMMARY ' 

Studies 'haw* shown that academic learning time is one of the most 
important determinants of student academic achievement. Academic learning 
time (ALT) includes the amount of time: 1) allocated to academic content areas, 
2) students are engaged in academic tasks, and 3) students experience high 
success on those tasks. Based on the results of research studies, teaching 
strategies fcr increasing student achievement were recommended: 

TO SPEND MORE TIME ON ACADEMIC SUBJECTS : 

- Reduce transition time between activities, 

- Decrease student misbehavior and/ time spent disciplining, 

- Decrease student wait time during activities, 

- Increase the amount of time scheduled for academic content areas. 

TO EVOKE MORE STUDENT ATTENTION TO ACADEMIC TASKS : 

- Praise students for appropriate behavior, 

- Be "withit", 

- Do more groupwork and provide more direct academic instruction, 

- Provide a variety of academic learning tasks, 

- Supervise academic seatwork activities more closely. 

TO PROVIDE MQuE DIRECT ACADEMIC INSTRUCTION : 

- Increase academic feedback (especially positive feedback), 

- Increase academic questions (especially low-level, convergent questions), 

- Increase ade.nic explanations and demonstrations, 

- Increase academic structuring/directions. 
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TO PROVIDE MORE OPPORTUNITIES FOR STUDENT HIGH TASK SUCCESS ; 

- Become more familiar with students 1 skills and knowledge, 

- Increase frequency and regularity of classroom testing, 

- Increase direct instruction (especially academic explanations, dernonstra 
tions, structuring/directions and feedback to the group), 

- Increase the number of activities in which previously learned material is 
reviewed. 
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